JPC-232598 - Senior Data Engineer
Job Posted: May 15, 2024 | Total views: 1

Job Description:

• Job Description

  JC-2028200/2028201

   

  IMMEDIATE to 30 days Notice period

   

  Location-PAN INDIA and check for Kolkata also.

   

   

  ates: inherit; font-variant-position: inherit; font-stretch: inherit; font-size: 15px; line-height: inherit; font-family: \'Segoe UI\', \'Segoe UI Web (West European)\', \'Segoe UI\', -apple-system, BlinkMacSystemFont, Roboto, \'Helvetica Neue\', sans-serif; font-optical-sizing: inherit; font-ke
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: #242424; overflow: hidden; position: relative; width: 1000px;\">

  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">Project Name	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">Role	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">Responsibilities	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">Skill	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">EL ask
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">HC260	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">Senior Data Engineer	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">Senior Data Engineer • Experience with No SQL and Relational DB o Preferred - Mongo DB otherwise any other No SQL DB. o PostgreSQL • Python scripting • Hasura, GraphQL, Apollo API etc. • Kafka, .Net/Java consumer experience with Kafka • Healthcare standards (FHIR, HL7, 837, 270) • Cloud Security (FrontDoor, WAF, NSGs, VNETs) • Nice to have - .Net 6(.Net v4.5+), Web API, WCF ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: red !important;\">Python, Azure cloud and Postgre SQL resource. Someone little senior. If the resource doesn’t know Postgre SQL but knows MongoDB or any other NoSQL DB and ready to lea Postgre SQL and gives commitment, Ravi will take the resource. They use Azure CICD. If the resource doesn’t know Azure CICD, resource should be ready to lea Azure CICD. ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">The work involves working in API area. They call it as Data APIs. They use Python to write queries and pull data from Postgre SQL using data APIs. Resource should be familiar with APIs.	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">B3/C1
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">OCTPW1085	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">Data Engineer	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: red !important;\">DataBricks/Kafka/Snowflake- Primary Skillsing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\"> Work on Datalake project. Will create data pipelines and deploy in production. Work on Datalake project. Will create data pipelines and deploy in production. Technical: Databricks, ADF, Kafka and Snowflake. Github ,Airflow can be trained, snowpipe is optional . Healthcare Experience is required .	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">B3/C1
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">HC406	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">Software Engineer	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">• Extract source data from inte al data exchange system. • Design and build the data Ingestion. Pipeline using Python and Spark. • Understand source data, do minimal data profiling and data mapping. • Load transformed data into snowflake datawarehouse (not a dimensional model). • Automate job scheduling through Airflow. • Create CICD pipelines (nice to have). • Participate in code reviews, quality assurance and documentation reviews.	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">5+ years of experience in a Data Engineer or equivalent role in enterprise initiatives § 3+ years in Python, Spark § 1+ year of experience in Snowflake § 3+ years of experience in working with SQL databases, Transaction replication and Change data capture technologies. § Experience building processes to support data transformation, data structures, metadata, dependencies, and workload management.  § Experience CI/CD workflows	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">B2
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">OCTPW1087	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">Senior Data Engineer	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">5-7 years of SSMS (SQL Server Management Studio) 5-7 years of SSIS 5-7 years of SQL 5-7 years of testing 5-7 years of Database Design and Lifecyle 5-7 years of Performance Tuning 3+ years of Data Analysis 1+ years of Configuration Management (TFS/GitHub) Clinical Data Knowledge Preferred (but not required)	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">B3/C1
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">HC421	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: inherit;\">Software engg.		ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">5+ years of experience in a Data Engineer or equivalent role in enterprise initiatives 3+ years in Python, Spark 1+ year of experience in Snowflake 3+ years of experience in working with SQL databases, Transaction replication and Change data capture technologies. Experience building processes to support data transformation, data structures, metadata, dependencies, and workload management.  Experience CI/CD workflows	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">B2
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">HC400	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">Sr.Data engg.	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">• Collaborate with cross-functional teams / data consumers / business stakeholders to understand their data-related needs, challenges, and goals. • Elicit and document business requirements, ensuring a thorough understanding of the underlying business processes. • Understand data lineage between source to target. • Document data requirements, data flows and get alignment with business stakeholders. • Facilitate effective communication, manage expectations, provide updates on progress, challenges, and dependencies.	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">• Overall IT experience of 8+ years. • Relevant experience of 3+ years. • Good in communication. • Hands-on experience in SQL. • Good understanding of data engineering and product development process. • Experience with agile methodologies and scrum framework. • Understanding Healthcare provider data, claims data, business knowledge (esp medicare / Part C)	ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: black !important;\">B3

   

   

  ates: inherit; font-variant-position: inherit; font-stretch: inherit; font-size: 15px; line-height: inherit; font-family: \'Segoe UI\', \'Segoe UI Web (West European)\', \'Segoe UI\', -apple-system, BlinkMacSystemFont, Roboto, \'Helvetica Neue\', sans-serif; font-optical-sizing: inherit; font-ke
  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: #242424;\">

  ing: inherit; font-feature-settings: inherit; font-variation-settings: inherit; margin: 0px; padding: 0px; vertical-align: baseline; color: #002060 !important;\"> 

About Company :
Purview is a leading Digital Cloud & Data Engineering company headquartered in Edinburgh, United Kingdom having a presence in 14 countries India (Hyderabad, Bangalore, Chennai and Pune), Poland, Germany, Finland, Netherlands, Ireland, USA, UAE, Oman, Singapore, Hong Kong, Malaysia and Australia.

We have a strong presence in UK, Europe and APEC, providing services to Captive Clients (HSBC, NatWest, Northern Trust, IDFC First Bank, Nordia Bank etc) in fully managed solutions and co-managed capacity models. Also, we support various top IT tier 1 organisations (Capgemini, Deloitte, Wipro, Virtusa, L&T, CoForge, TechM and more) to deliver solutions and workforce/resources.

Company Info: