JPC-232622 - Data Engineer
Job Posted: May 14, 2024 | Total views: 1

Job Description:

• Job Description

  Data Pipeline Architecture and Development
  
  

  • Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine lea
    ing models and analytics.
    
    
    

  Data Integration
  
  

  • Work closely with data scientists, ML engineers, and stakeholders to ensure that data is accessible, consistent, and reliable for ongoing projects.
    
    
    

  API and Data Services
  
  

  • Develop and maintain APIs for data access and manipulation, and integrate with exte
    al data services as needed.
    
    
    

  Data Storage
  
  

  • Manage and optimize data storage solutions, including relational databases, Search Engines like Elasticsearch and NoSQL databases, to support the requirements of machine lea
    ing models.
  • Understand data engines and structure to effectively design solutions for transactional, analytics, and search purposes.
    
    
    

  Data Quality and Gove
  ance
  
  

  • Implement processes to monitor data quality and ensure production data is always accurate and available for key stakeholders.
    
    
    

  Collaboration and Support
  
  

  • Collaborate with ML engineers to assist in data-related technical issues and provide architectural guidance and solutions.
    
    
    

  Security and Compliance
  
  

  • Ensure compliance with data security and privacy policies.
    
    
    

  Documentation
  
  

  • Maintain clear and up-to-date documentation including data dictionaries, metadata, and architectural diagrams.
    
    
    

  Qualifications
  
  Skills and attributes to success
  
  

  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.
  • 3+ years of experience in a Data Engineering role.
  • Proficiency in SQL and programming languages like Python, Java, and Scala.
  • Hands-on experience with big data technologies like Hadoop, Spark and Flink.
  • Familiarity with machine lea
    ing frameworks such as TensorFlow, PyTorch, or similar.
  • Strong understanding of data warehousing concepts, ETL processes, and data modeling.
  • Experience with API development and integration with data services.
  • Experience with cloud platforms like AWS, GCP.
  • Knowledge in DevOps, CI/CD methods, and containerization technologies like Docker or Kube
    etes.
  • Experience with real-time data processing.
    
    
    

  Technical stack
  
  

  • Programming Languages: Python, Java, Scala, SQL, Bash
  • Big Data Technologies: Hadoop, Spark, Flink
  • Databases: MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
  • Cloud Platforms: Azure
  • API Development: RESTful APIs, GraphQL, OpenAPI
  • Data Services: Kafka, RabbitMQ
  • Containers: Docker, Kube
    etes
    
    
    

  What we look for
  
  If you are a performance-driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. Bias for action and a passion to conquer new frontiers in the AI space is at the heart of the Core42 community.
  
  What working at Core42 offers
  
  Culture: An open, diverse and inclusive environment with a global vision that encourages personal growth and focuses on ground-breaking, industry-first innovations.
  
  Career: Outstanding lea
  ing, development & growth opportunities via structured training programs and innovative, high-tech projects.
  
  Work-Life: A hybrid work policy to strike the perfect balance between office and home.
  
  Rewards: A competitive remuneration package with a host of perks including healthcare, education support, leave benefits and more.
  
  If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible.

About Company :
Purview is a leading Digital Cloud & Data Engineering company headquartered in Edinburgh, United Kingdom having a presence in 14 countries India (Hyderabad, Bangalore, Chennai and Pune), Poland, Germany, Finland, Netherlands, Ireland, USA, UAE, Oman, Singapore, Hong Kong, Malaysia and Australia.

We have a strong presence in UK, Europe and APEC, providing services to Captive Clients (HSBC, NatWest, Northern Trust, IDFC First Bank, Nordia Bank etc) in fully managed solutions and co-managed capacity models. Also, we support various top IT tier 1 organisations (Capgemini, Deloitte, Wipro, Virtusa, L&T, CoForge, TechM and more) to deliver solutions and workforce/resources.

Company Info: