Bigabid Slashes Latency and Boosts Query Performance 400x Using AWS and Firebolt
Customer Company Size
Mid-size Company
Region
- Middle East
Country
- Israel
Product
- Amazon Simple Storage Solution (Amazon S3)
- Amazon Elastic Compute Cloud (Amazon EC2)
- Firebolt
Tech Stack
- AWS
- Firebolt
- MySQL
Implementation Scale
- Enterprise-wide Deployment
Impact Metrics
- Productivity Improvements
- Cost Savings
- Digital Expertise
Technology Category
- Analytics & Modeling - Big Data Analytics
- Analytics & Modeling - Real Time Analytics
- Platform as a Service (PaaS) - Data Management Platforms
Applicable Industries
- Software
Applicable Functions
- Business Operation
- Product Research & Development
Services
- Cloud Planning, Design & Implementation Services
- System Integration
About The Customer
Bigabid is a digital advertising technology company based in Israel, founded in 2016. The company specializes in using big data and machine learning to enhance app growth for developers. Bigabid's platform processes vast amounts of data and connects with multiple ad suppliers and exchanges in near real-time, providing clients with insights into app performance. This enables clients to target specific audiences, increase app usage, and optimize advertising spend. Bigabid's business intelligence platform analyzes various metrics such as impressions, ad clicks, app installs, and in-app purchases. The company also has an internal data analysis platform used by developers and campaign managers to continuously optimize performance. Bigabid's infrastructure is built on AWS, utilizing services like Amazon S3 for data lakes and Amazon EC2 for compute capacity. The company chose AWS for its reliability and diverse range of managed services, which simplify data efforts across the organization.
The Challenge
Bigabid's analytical databases, originally based on MySQL, were not meeting the performance requirements needed for their operations. The company faced significant delays in generating data insights, with some processes taking days to complete. Additionally, they struggled to access data older than three months due to heavy data aggregations, which hindered their ability to perform seasonal or year-to-year comparisons. Bigabid aimed to analyze data for a million ad auctions every second and manage data lakes containing hundreds of terabytes in near real-time. This required accessing tables with billions of rows to create hundreds of live dashboards. To address these challenges, Bigabid needed to build a high-performance big data infrastructure and merge its internal BI and data analysis platforms into a central data platform.
The Solution
To address its performance challenges, Bigabid embarked on a project to build a high-performance big data infrastructure. The company evaluated several high-performance database options and chose AWS Partner Firebolt for its impressive capabilities. Firebolt significantly improved Bigabid's BI efforts, allowing the company to analyze a test dataset of 100 million records in seconds, compared to minutes with other databases. In August 2022, Bigabid adopted Firebolt's analytics, integrating it with its existing Amazon S3 data lake and merging its BI and analytics systems. By early 2023, Bigabid had completed its migration project, optimized its systems, and built new dashboards. The integration with Firebolt and AWS allowed Bigabid to query a database containing 30 billion records and receive results in a second. The migration also solved the challenge of analyzing older data, enabling real-time data delivery to dashboards without limitations on data age. Bigabid now has a single BI dashboard that provides real-time business insights and can be customized quickly. The company expects to further optimize its platform and gain a better understanding of increasing data volumes as it continues to grow.
Operational Impact
Quantitative Benefit
Case Study missing?
Start adding your own!
Register with your work email and create a new case study profile for your business.
Related Case Studies.
Case Study
Infosys achieves a 5–7 percent effort reduction across projects
Infosys, a global leader in consulting, technology, and outsourcing solutions, was facing significant challenges in application development and maintenance due to its distributed teams, changing business priorities and the need to stay in alignment with customer needs. The company used a mix of open source, home-grown and third-party applications to support application development projects. However, challenges resulting from distributed teams using manual processes increased as the company grew. It became more and more important for Infosys to execute its projects efficiently, so they could improve quality, reduce defects and minimize delays.
Case Study
Arctic Wolf Envelops Teamworks with 24x7 Cybersecurity Protection and Comprehensive Visibility
Teamworks, a leading athlete engagement platform, faced rising cyberthreats and needed enhanced visibility into its network, servers, and laptops. With software developers connecting from all over the world, the company sought to improve its security posture and position itself for future growth. The company had a secure platform but recognized the need for a more proactive solution to identify gaps within its technology infrastructure. Data exfiltration and malicious access were top concerns, prompting the need for a comprehensive security upgrade.
Case Study
Sawback IT and Datto Save Client From a Costly Mistake
Ballistic Echo, a software development house, faced a critical challenge when human error led to the deletion of thousands of lines of unique code. This incident occurred before the code was pushed to source control, resulting in significant loss of time, revenue, and work. The previous file-level backup solution they used was slow and inefficient, making it nearly impossible to manually recreate the lost work. The need for a more reliable and efficient business continuity solution became evident to avoid such disasters in the future.
Case Study
Opal Helps Customers Shine Thanks to Datto
SP Flooring & Design Center faced a ransomware attack that encrypted and locked their files. The attack was initiated through a compromised service account set up by an outside vendor. The ransomware infection was isolated quickly, but there was a concern about the extent of the data at risk. The company had backups in place but was unsure of how much information was compromised. The situation required immediate action to prevent further damage and restore the affected data.
Case Study
Zapier Aggregates Multiple Analytics in a Single Dashboard with the New Relic Platform
Zapier, a company that enables non-technical users to push data between hundreds of web applications, was facing a challenge in automating and provisioning servers for optimal performance. The company's environment consisted of 50 Linux servers on the Amazon Elastic Compute Cloud (EC2), a Django application split across several servers, and a backend consisting of a dynamic number of celery task workers fed by messages published to a RabbitMQ cluster. They also maintained a number of internal web services on nginx in front of Gunicorn and Node.js processes. Redis handled simple key and value stores, with logging handled by Graylog2 and ElasticSearch. However, they realized that no level of automation would be sufficient without an effective monitoring solution in place. They needed a tool that could provide immediate alerts when something was breaking and could be easily implemented into their environment.
Case Study
Pipeline Insight Case Study: YARCDATA
YarcData faced challenges in determining the conversion rates of prospects into customers through various marketing efforts and identifying the source of its leads. They wanted to know the percentage of opportunities in the sales pipeline that came from different marketing events, web downloads, or self-sourced sales opportunities. Additionally, they needed the ability to drill down into the data to guide where to allocate more marketing dollars based on the success of previous efforts. Previously, YarcData relied heavily on spreadsheets and Salesforce.com reports, which made it difficult to extract the exact information they needed. This reliance on spreadsheets represented about 70% of their data presentation.
