HERE'S HOW A LEADING IOT COMPANY REINED IN HIGH-VOLUME DATA SOURCES AND MANAGED LOGS BETTER AT SCALE.
Oracle Cloud | Log Management | RBAC | SSO | Alerts
Company details
The client is an established fintech company that invests in and partners with financial institutions around the world with the aim of fostering financial inclusion for unserved and underserved communities. They facilitate management consulting and technology to support their partners and new business initiatives.
Industry/vertical: Smart Home & IoT Solutions
The Challenges
Owing to their increasing popularity and demand, our client was acquiring new customers at a rapid pace. But as their customer base grew, so did their requirements for better data management at scale, longer data retention, and affordable storage costs. Their systems consistently generated 3 TB of log data per day, which was impossible to ingest using a SaaS solution without significantly increasing their IT spend. They also wanted to own their data to achieve better security, governance, and compliance and ideally wanted a SaaS-like experience with a PaaS solution.
The client evaluated Elasticsearch but soon discovered that the raw cost of disk storage that Elasticsearch consumes would quickly exceed their current SaaS spend. They also realized that they’d need to build significant expertise in Elasticsearch to run the solution in-house. Elasticsearch also posed a challenge to have flexibility with data retention on-demand without backing a costly storage project. The client then switched to a SaaS solution named LogEntries. However, LogEntries could not scale beyond 400 GB/day due to the high storage costs involved.
The client was also looking to open their log data to a key OEM partner while restricting access to logs for the OEM. They need RBAC capabilities embedded in their log management system to help them control and govern log access within a single platform. With their current log management stack not meeting their data management needs nor being financially reasonable, they were looking for a single platform that would do it all.
The Need
- Log data aggregation, storage, and
management at scale - Log aggregation and unification from multiple data sources
- Enhanced data ingestion rates with the ability to manage surges and spikes
- Reasonable log storage costs and longer retention
- Enterprise-grade RBAC to control data access across internal and partner teams
The Apica Advantage
How Apica Helped
We deployed Apica PaaS within their existing Oracle Cloud ecosystem. A dedicated support team from Apica manages the infrastructure needed for Apica PaaS within the client’s existing Oracle Cloud accounts. We first set up SSO by leveraging the client’s Okta setup. Our native integrations with Prometheus and AWS Athena helped quickly set up log ingestion from these data sources.
We also set up alerts within Apica and integrated them with the client’s Opsgenie ITOM so that alerts generated within Apica are forwarded instantly to Opsgenie for further action and automation.
Results
Key Statistics
- 4X more data unified per month
- 3 Billion logs ingested per day
- Peak load of 160 GB/h
- 100% uptime over 90 days
- 50% TCO reduction
- 8x ROI improvement
- #ZeroStorageTax with 1-click
extension of retention duration