Case Studies

About

A global IT staffing company that serves customers in every major vertical from startups to Fortune 100 companies, was looking to modernize their business operations so they could more reliably make data-driven business decisions.

‍

Business Challenge

The IT staffing company initially built a dual-purpose system that functioned as both a customer relationship management and enterprise resource planning tool. While custom-built for their own specifications, the existing system created some unique business challenges - specifically in the log analytics portion of the tool built on Elasticsearch.

The first challenge was price; between the Elastic licensing fees and the cost of labor associated with upkeep and maintenance, it was not a cost-effective solution. Next was reliability; the system was prone to frequent downtime and performance issues. Add to that, the business disruptions caused both internally and externally, signaled that the customer was ready for a change.

‍

Technical Challenge

Cloudtech analyzed their data infrastructure, and determined that the current solution - self-managed ELK stack - to be suboptimal compared to the licensing fee costs. Also, the solution required eight engineers to maintain and troubleshoot.

In addition, data streams were vulnerable to disruption, and lack of shard availability and rebalancing issues caused frequent search throughput breakdowns. Lastly, upgrading the solution was tedious and time-consuming, taking up to a month in some cases.

‍

‍

Log Analytics Solutions

Based on the challenges, Cloudtech proposed a centralized logging platform using Amazon OpenSearch Service, AWS Fargate, Amazon Elastic Container Registry (ECR), and Amazon Elastic Kubernetes Service (EKS). This platform provided the customer with the scalability and data integrity required to store and analyze logs generated by their CRM/ERP tool. Given that cost and maintenance were important issues to address, Amazon OpenSearch Service was chosen for its speed, price, and security. Additionally, as a managed service, it alleviated the maintenance overhead associated with the previous solution.

‍

“The cost savings and downtime reductions we experienced were far above anything we expected, and have since significantly impacted our business in a positive way. The insights we get from reliable log analytics are driving our business forward.”
- CTO, IT Staffing Company

‍

Log Analytics Solution Results

Cloudtech’s solution enabled the customer to centralize their logs, process logs in real-time, gain insights, and make data-driven decisions. Amazon OpenSearch Service made it easier to perform search operations, enhance search efficiency, and provide scalable searching. In fact, the ability to scale up and down in minutes improves search throughput. In addition, OpenSearch Service allows the customer to schedule service software and auto-tune updates during off-peak hours, helping to better plan their deployments. Most importantly, the customer realized 40% cost reduction and 80% reduction in downtime.

‍

Reduce Costs with Log Analytics Solution

Implement your own data processing and log analytics solution, and realize the business benefits of reduced downtime, optimized costs, and improved business decisions. Contact Cloudtech today.

‍

About bNoteable

bNoteable helps you showcase your hard work on a path to reach your goals by leveraging your band, orchestra, or vocal experience to its fullest potential to college admissions boards.
This begins early by setting a course that allows you to turn those hours of fun and friendship into leadership experience, hours of practice and performances into scholarship potential, and years of music classes into overall higher SATs and GPA scores, and academic achievement.

Executive Summary

Continuing the development of a musician networking platform which involved implementing new features, enhancing the existing ones, and fixing bugs/errors/issues in the platform by improving its efficiency and productivity along with making the platform responsive.

Problem Statement

Our client wanted us to design and create a social platform where each and every user is able to connect and interact with one another easily. He came to us after a bad experience with some other company and was expecting to continue the development by improving website performance as well as efficiency.
The platform had various bugs which needed to be fixed and some major features were to be added like payment service, OTP service, adding more security along with improving existing features. Performance of platform was being affected as there were some major issues like:
1. Deployment architecture- Everything was deployed on a single EC2 instance due to which there was a high amount of downtime. The performance was impacted more when the user base was increased.
2. The videos on his platform were taking a lot of time to load.

Our Solutions

1) We followed MVC architecture for developing REST API using express as middleware and mongoose for managing data in MongoDB. Authenticated API with jwt by using JSON web token package.
2) Added payment service in the platform by integrating stripe payment gateway with help of stripe package, created OTPs for security/validation which was communicated via SMS with help of Twilio.
3) To improve the performance, we deployed the backend on a separate ec2 instance with Nginx as reverse proxy and pm2 as process manager which comes with a built-in load balancer and helps to keep the application alive forever.
4) Installed Nginx on the server, and changed the Nginx.conf file configurations as per the requirement and it worked as a load balancing solution. Also replaced the lets encrypt SSL certificates with ACM(AWS Certificate Manager) to make certificate renewal, provision, and management process better as well as easy.
5) For adding new features to the platform, the frontend involved creating several components, services, directives, pipes, and modules in Angular.
6) To reduce the load time we implemented Lazy loading with help of Lazy load routes. The reason behind increased load time for videos was the use of video tag over secured protocol, to solve this we used iframe for rendering videos which proved to be much faster.
7) Changed the existing deployment architecture and moved the front-end to S3 so that load on the server can be reduced. We moved the front-end to S3 with CloudFront as CDN for speeding up the distribution of web content and improving performance.

Technologies

Angular 10, Node, Express, MongoDB, AWS S3, EC2, CloudFront

Success Metrics

1. Provided all the deliverables within the expected deadlines, improved performance as down time reduced and videos were no longer buffering for a long time.
2. Met all the expectations of the client and with positive feedback. All his meetings with directors and students were successful due to which he wanted us to implement some more new features on his platform.
3. Continuous reporting of progress to the client.

‍