Clarity Travel Technology solutions
|Data Engineer
Chennai, Tamil Nadu, India
Summary
Spearheaded data engineering initiatives at Clarity Travel Technology solutions, designing and optimizing ETL pipelines, data warehouses, and automation scripts to enhance data quality and support strategic decision-making.
Highlights
Optimized MySQL query performance by implementing strategic indexing, resulting in a significant reduction in execution time and improved data retrieval efficiency.
Engineered a scalable Data Warehouse on Snowflake, utilizing Apache Airflow for orchestration and DBT for robust data transformations, enhancing data accessibility and analytical capabilities.
Developed an AWS-native data pipeline with Lambda and S3, automating the extraction, cleaning, and transformation of flight invoice text files into structured JSON for downstream analysis.
Improved data quality and search relevance by automating the correction of hotel type misclassifications using Python, reducing errors and enhancing user experience.
Streamlined business intelligence by designing and scheduling Apache Airflow ETL workflows, automating periodic report distribution to key stakeholders for informed decision-making.