![]() Architectureĭata from individual microservices are currently published to SNS (a lightweight eventing system between microservices). This drove the need for a separate real-time data pipeline and Velocity was born. Non-availability of data on RedShift (in real-time) was not a concern for reporting but was a major change for the real-time dashboards. Hence, instead of DMS jobs (that copy the data in realtime), the data team planned to use the ETL jobs to copy the data to Redshift in batches (with separation of multiple hours). When the data team analysed the root cause, we found that RedShift, like most Data Warehouse systems, is optimised for batch updates, especially when the read traffic is less. This started impacting the performance of the RedShift system, along with a substantial increase in query response time. But with an increase in business, we saw our backend data sources increase rapidly. The data in Redshift is used by the operations team for various purposes like BI Reporting (through PowerBI/Looker), real-time monitoring of business metrics (Metabase dashboard) and ad-hoc queries (Metabase Questions). The DMS jobs copied any edited data over to Redshift in real-time. Given how querying data from multiple sources might slow down our operations, we set up our data platform to copy the data from individual databases to AWS Redshift via DMS jobs. But from Halodoc's operations point-of-view, a single transaction by a user might span across multiple business domains. Business domains like Pharmacy Delivery, Tele Consultations, Appointments, and Insurance have their own microservices. These microservices have access to their data but rely on the APIs to retrieve data from other microservices. Brands like Treebo Hotels, Color, GlobalGiving, and Paychex have experienced success in the past utilizing Metabase’s platform and tools.Halodoc backend consists of multiple microservices that interact with each other via REST APIs. In addition, companies can access real-time activity regarding what their teams are learning, as well as manage a database where collections of data can be created, organized, and shared. Integrating with programs like MySQL, Mongo, Google BigQuery, and Druid, the Metabase platform works by allowing associates to filter and group data without writing a line of SQL, explore connections between data, visualize results with graphs and more, and work with SQL on a powerful and elegant interface. The Metabase open-source system supports internal and enterprise-wide sharing, measuring, and analyzing of data and also provides tools to assist with complexities that arise as companies grow. Metabase team members are offered the flexibility to define their own work schedules, work from wherever they want, and be part of “an environment that fosters growth, learning, and development.” The company’s fully distributed, global team works from locations “from California to Thailand,” with 50% of associates located outside the United States. #Metabase alerts software#Metabase offers an open-source platform that allows company teams to “ask questions and learn from data.” A technology startup founded in 2014, the company has hired in the past for 100% work-from-anywhere jobs with opportunities offered across varied fields, like software development, writing, customer service, sales, and graphic design, among related career areas. Researched & Written by Emily March on the FlexJobs Team ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |