Senior Data Engineer
December 18, 2024
Open
Open
Location
Vietnam
Occupation
Full-time
Experience level
Mid-level
Job Description
The ideal candidate will be responsible for integrating various systems using Kafka, building monitoring tools, and developing APIs in Python. You will work closely with other engineering teams to design and implement data-driven solutions and ensure optimal performance and reliability of our systems.
Responsibilities
- Writing reusable, testable, and efficient code
- Design and implementation of low-latency, high-availability, and performant applications
- Integration of different databases and systems via Kafka
- Data analytics
- Integration of data storage solutions
Skills And Qualifications
- 3+ years of experience as a software developer
- Expert in Python, with knowledge of at least one Python web framework (such as Django, Flask, FastAPI)
- Perfect SQL skills (PostgreSQL, MySQL)
- Good Kafka skills (Connectors, KSQL, etc)
- Experience with time series and noSQL databases (prometheus, MongoDB)
- Experience with different data visualization tools (Grafana, Metabase, etc.)
- Experience with containers (Docker, Docker Swarm, k8s)
- Familiarity with some ORM (Object Relational Mapper) libraries
- Able to integrate multiple data sources and databases into one system
- Understanding of the threading limitations of Python, and multi-process architecture
- Understanding of accessibility and security compliance Knowledge of user authentication and authorization between multiple systems, servers, and environments
- Understanding of fundamental design principles behind a scalable application
- Familiarity with event-driven programming in Python
- Able to create database schemas that represent and support business processes
- Strong unit test and debugging skills
- Proficient understanding of code versioning tools (Git)
- Excellent time management and multitasking skills
- Good analytical and problem-solving skills