Data Engineer

Data Engineer Pune, India About Us Coditation Systems was founded by a serial entrepreneur, and a team of young talented technologists, some of who have grown to spearhead the organization. With its inception in 2016, we became a boutique technology services and solutions firm specializing in Machine Learning & AI, Data Engineering, and Cloud. We have a team of ninja architects, data scientists, data engineers, and software engineers having decades of collective experience of applying emerging technologies to build cutting edge software products. What are we looking for? We are looking for an experienced Data Engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods. If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you. A Day in the Life ● Building productionized data ingestion and processing pipelines using any of these Java/Spark/Scala/Python/GCP/Cloud or similar. ● Designing and implementing a fully operational production grade large scale data solution on Snowflake and Amazon Redshift Data Warehouse . ● Designing and implementing production grade data warehousing solutions on large scale data technologies such as Teradata/Oracle/DB2. ● Large scale Data Migration from on premise to cloud data warehouses. ● Building data ingestion data pipelines. What you will need ● Understanding of SQL concepts and experience in the same. ● Excellent SQL skills ● Good to have knowledge of hadoop ecosystem, hive, YARN, EMR, EC2, S3 etc. ● Experience of writing data transforms ● Experience working with Unix, Linux Operating Systems. ● Excellent presentation and communication skills, both written and verbal. ● Ability to problem solve and architect in an environment with unclear requirements. ● Self driven with good probleming solving skills. ● Experience in working with AWS/Azure/Google or similar data services. ● Experience with dev-ops tools and shell scripting knowledge is a plus. ● Bachelor's degree in Computer Science/Engineering or equivalent.