EC2 workflow execution process automation
Improved company's operational efficiency with power of RDA automation
Background
The Panther Group, a cannabis advisory firm and merchant bank based in the United States, manages three cannabis venture funds, spanning across 25+ sub-sectors of the cannabis industry. They offer a range of services to help grow cannabis businesses. One of their key processes involves running a workflow that generates some data and updates the data in Redshift. This workflow needs to be executed once a week for 6 hours. However, the EC2 instance that runs this workflow is kept running for the whole week, leading to increased costs due to idle utilization of the EC2 instance.
The current process involves several manual steps. Nima, an employee at the Panther Group, opens the EC2 instance properties and copies the IP address of the EC2 instance. Using this URL, Nima logs into the Matillion system. This displays a portal. Nima then opens the ‘Tree-Data-Extraction’ and changes dates in the jv_dates script. To get the dates that need to be updated into the jv_dates, Nima logs into RedShift and runs the SQL query under ‘redshift-cluster-matil’ in the query editor. The above query gives a date of the last execution. The dates to be considered are the start day is the date after the last execution date and the end day will be one day before the current date. Once the data is ready, Nima right-clicks on the background in Matil and presses re-validate job and makes sure the validation passes. Once the validation is passed, the Tree-Data-Extraction job is executed. As soon as the Tree-Data-Extraction, ‘Hubspot-Sync-To-Redshift-Orch’ job is executed. The process ends after the successful execution of the Hubspot-Sync-To-Redshift-Orch job.
Process Flow
The EC2 Workflow Execution process flow diagram for the Panther Group's Cannabis BPO involves several stages, represented visually in a process flow chart. The process starts with the initiation of the EC2 instance and ends with its termination. The IntelliBuddies platform can be utilized for better implementation of other policy-driven processes within the organization.
Solution
The IntelliBuddies RDA platform provides an automation solution for the EC2 Workflow Execution process. The solution involves the following steps:
- IntelliBuddies start the EC2 instance and note down the new IP assigned. Once the IP is available, it navigates to this machine and login to Matillion.
- Upon success login, IntelliBuddies task automation buddy login to the Redshift account and run a query to get dates that need to be passed into the Tree-Data-Extraction script.
- IntelliBuddies open Matillion and navigate to the Tree-Data-Extraction script, modify the dates, and validate the job. - Once the validation is completed, execute the job and wait for it to finish.
- Upon completion of the Tree-Data-Extraction job, initiate the job Hubspot-Sync-To-Redshift-Orch. Wait for the Hubspot-Sync-To-Redshift-Orch to complete and stop the EC2 instance once the task is completed.
This solution automates the entire process, eliminating the need for manual intervention. It ensures that the EC2 instance is only running when it needs to, thereby reducing costs. It also reduces the risk of errors that can occur with manual data entry and ensures that the workflow is executed accurately and efficiently.
Conclusion
The IntelliBuddies RDA platform has provided a valuable solution for the Panther Group's Cannabis BPO. By automating the EC2 Workflow Execution process, IntelliBuddies has helped the company reduce costs, improve efficiency, and minimize the risk of errors. The automation solution has eliminated the need for manual intervention, freeing up Nima and other employees to focus on more strategic tasks. This has not only improved the company's operational efficiency but also enhanced its service delivery. The successful implementation of this solution demonstrates the power of automation in transforming business processes and driving business growth.
Lets Talk...
