Data Engineer

CHI Software is seeking a Data Engineer to join their growing team. The role focuses on designing and implementing real-time data processing and analytics solutions for high-traffic web applications using AWS cloud technologies.

• Design scalable and robust AWS cloud architecture
• Utilize AWS Kinesis for real-time data streaming and aggregation
• Implement AWS Lambda for serverless data processing
• Configure AWS RDS for structured data storage and DynamoDB for NoSQL requirements
• Develop and deploy data pipelines using AWS Glue for ETL processes
• Write Python scripts and SQL queries for data transformation and loading
• Set up CI/CD pipelines using AWS CodePipeline and CodeBuild
• Monitor system performance and data quality using AWS CloudWatch
• Collaborate with other teams to integrate data sources and optimize data flow
• Build ETL pipelines from S3 to AWS OpenSearch using AWS Glue

• Upper-Intermediate or higher English level
• Experience with AWS services: Glue Studio, Redshift, RDS, Kinesis, Lambda, Step Functions, Athena, S3, OpenSearch
• Proficiency in Python and SQL
• Knowledge of ETL tools and data pipeline development
• Experience with dbt, Snowflake, or Apache Iceberg
• CI/CD pipeline experience
• Understanding of AWS IAM and encryption services
• Data quality and monitoring expertise

Real-time data processing project with AWS cloud technologies. Tech stack includes AWS services, Python, SQL, CI/CD, dbt, and Snowflake.