Follow us

Careers @ CIPIO

Back to jobs

Sr Back-End / Big Data Engineer

Bangalore | Full Time

Key Responsibilities

  • Build reusable frameworks for interaction between different components in platform
  • Apply Data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools for machine learning pipelines and Time series data analysis
  • Monitoring data performance and define infrastructure needs
  • Contribution to our pluggable ELT framework for various data sources to extract data and store into datalake
  • Work closely with data science team to build data preparation pipelines for scale
  • Streaming data using tools like Kafka from events generated across sources

Required Skills

  • 5 years of indepth experience in Big Data/Back End
  • Ability to gather accurate requirements and work closely with stakeholders to prioritize tasks and the scope of development
  • Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, CouchDB)
  • Experience with Spark, or the Hadoop ecosystem and similar frameworks
  • Object Oriented analysis and design using common design patterns
  • Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
  • Experience in cloud infrastructure AWS/GoogleCloud/Azure
  • Exposure to Python and AI/ML frameworks
  • Creative and innovative approach to problem-solving
  • Experience in working on Source Control, Testing & Deployment CVS, SVN, JUnit, jMock, ANT, Maven