Technical Lead Data Engineer | Lead Data Engineer Roles and Responsibilities Job | Technical Data Engineer Job

By | May 25, 2022

Technical Lead Data Engineer | Lead Data Engineer Roles and Responsibilities Job | Technical Data Engineer Job

Job Description:

We are looking for a Technical Lead Data engineer to be part of the product engineering team. The candidate should have over 7-10 years of experience in technologies like Mysql, Spark/Databricks, Python/Scala/Java, Hadoop, Tableau/ Pentaho


We build breakthrough software products that power digital businesses. We are an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. Our key differentiator is our Product Mindset. Our development teams focus on building for outcomes and all of our team members around the globe are trained on the Product Mindset’s core values – Minimize Time to Value, Solve For Need, and Excel at Change. Our teams apply this mindset to build digital products that are customer-facing and revenue-generating. Our business-minded approach to agile development ensures that we align to client goals from the earliest conceptual stages through market launch and beyond.

In 2021, 3Pillar Global India was named as a “Great Place to Work” for the fifth year in a row based on how our employees feel about our company, collaborative culture, and work/life balance – come join our growing team!

Technical Competencies

  • Experience in acquiring datasets aligned with business needs
  • Experience in developing algorithms to validate and transform data into meaningful actionable information
  • Able to build data pipelines for analytical insights
  • Extensive experience in RDBMS such as MySQL, Oracle, SQL Server, etc.
  • Experience in programming languages Java, Scala, or Python
  • Experience in big data processing technologies like Hadoop, HBase, Cassandra, Spark, Databricks, etc.
  • Experience in creating predictive models and identifying patterns
  • Experience in Cloud-based services such as Amazon AWS, Microsoft Azure, or Google Cloud Platform
  • Experience with Scrum and/or other Agile development processes
  • Translating designs and wireframes into high-quality code
  • Must have experience in Unit testing
  • Ability to apply design patterns consistently
  • Practical application of software product development standards and methodologies including Agile
  • Demonstrated problem-solving, analytical and troubleshooting skills
  • Strong written and oral communication skills are required

Roles And Responsibilities

  • Requirement analysis, coding, design, implementation, testing, problem analysis, and resolution, and technical documentation
  • Able to create and maintain existing and new data pipelines
  • Understanding of technical requirements, how they relate, and familiarity with general performance practices like caching, query optimization, memory utilization, clean-up etc.
  • Passion o keep up-to-date with the latest happenings in core technology
  • Understands how various requirements impact project budget and new revenue opportunities,
  • Optimizes delivery, meets deadlines and delivers results
  • Build reusable code and libraries for future use
  • Demonstrate unexpected value to your client
  • Understands complimentary product development capabilities and the interactions between disciplines
  • Participates in holistic discussions about the broader product development lifecycle,
  • Watches for triggering events, including changes within the organization or outside world that provide opportunities or create risks for 3Pillar,Develops strong relationships with client personnel working directly on the account
  • Ability to mentor interns and support peers


  • A competitive annual salary based on experience and market demands
  • Flexi-timings/Work from Anywhere Policy
  • Medical insurance with the option to purchase a premium plan or HSA option for your entire family
  • In-house Food and Refreshments
  • Regular Health check-up camps arranged by the company
  • Recreational activities (Pool, TT, Wii, PS2)
  • Business casual atmosphere

Apply Now