Senior Data Engineer

Dataforest is seeking a Senior Data Engineer to join their team and work on the Dropship project, a cutting-edge data intelligence platform for e-commerce analytics. You will be responsible for developing and maintaining a scalable data architecture that powers large-scale data collection, processing, analysis, and integrations.

• Develop and maintain a robust and scalable data processing architecture using Python
• Design, optimize, and monitor data pipelines using Kafka and AWS SQS
• Implement and optimize ETL processes for various data sources
• Manage and optimize SQL and NoSQL databases (PostgreSQL, TimeScaleDB, Elasticsearch)
• Work with AWS infrastructure to ensure reliability, scalability, and cost efficiency
• Proactively identify bottlenecks and suggest technical improvements

• 4+ years of commercial experience with Python
• Advanced experience with SQL DBs (optimisations, monitoring, etc.)
• PostgreSQL - must have
• Solid understanding of ETL principles (architecture, monitoring, alerting, search and resolve bottlenecks)
• Experience with Message brokers: Kafka, Redis
• Experience with Pandas
• Familiar with AWS infrastructure (boto3, S3 buckets, etc)
• Experience working with large volumes of data
• Understanding the principles of medallion architecture

Plus: Understanding noSQL DBs (Elastic), TimeScaleDB, PySpark, Experience with e-commerce or fintech

• Working in a fast-growing company
• Great networking opportunities with international clients
• Challenging tasks
• Personal and professional development opportunities
• Competitive salary fixed in USD
• Paid vacation and sick leaves
• Flexible work schedule
• Friendly working environment with minimal hierarchy
• Team building activities, corporate events