Data Engineer
Job Duties:
- Build data-intensive solutions on AWS/GCP/Azure to help customers transition to cloud
- Collaborate with data scientists to design and deploy solutions on cloud
- Design data layout using object storage (S3/Cloud Storage) or databases to enable spark and other processes to access data efficiently
- Keep abreast with latest technologies and apply them to solve big data problems
- Familiarity with containers and their orchestration to manage workloads
- Learn and contribute towards knowledge sharing sessions
- Automate solutions and improve overall productivity and reducing the cost footprint of resources.
- Identify and solve performance and scalability issues
- Understand business problems and propose technical solutions
- Work with a global development team to develop production solutions
Skills:
- Sound understanding of cloud platforms and its service offerings (at least one of AWS/GCP/Azure)
- Strong programming background in either Python and SQL
- Strong understanding of data engineering, data warehousing concepts
- Knowledge of object storage like S3 and designing data layouts for efficient data access
- Familiarity with Spark and big data technologies like Hive, BQ,EMR, DataProc , Dataflow will be given extra consideration.
- Experience with container technology (Docker) is a plus.
- Prior experience with data visualization technologies like SAS VA, Tableau is a plus
- Education: Master’s Degree in Computer Science or Equivalent
Travel
- Travel up to 25% is required
Job Features
Job Category | Data Engineer |