JPC-231961 - Data Bricks
Job Posted: May 14, 2024 | Total views: 1

Job Description:

• Job Description

  Location: Bangalore

  WFO: Day 1

  CBR: 19451 INR/Day

  JD: Attached

  Mandate Skills: Databricks, Pyspark,ADF, SQL

  Good to have: ADLS, Python/spark

  No. of Positions: 10

  Contract JC:

  Client interview: Yes

  Experience Lvl: 7 – 10 years

   

  Data Engineer Databricks - Job Description

  ·         Candidate with  6+ years of IT experience and  atleast 2 years in Data Engineer role

  ·         Required :  a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field

  ·         Experience with Azure: Azure Data Factory, Azure Data Lake Storage, Databricks

  ·         Experience with relational SQL and NoSQL databases,

  ·         Experience with object-oriented/object function scripting languages: Experience with anyone of these Pyspark, Python, SQL, Scala, Spark-SQL etc.

  ·         Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

  ·         Experience building and optimizing \'big data\' data pipelines, architectures and data sets.

  ·         Strong analytic skills related to working with unstructured datasets.

  ·         Build processes supporting data transformation, data structures, metadata, dependency and workload management.

  ·         A successful history of manipulating, processing and extracting value from large disconnected datasets.

  ·         Experience in Sprint and Agile

  ·         Experience supporting and working with cross-functional teams in a dynamic environment.

   

  Added Advantage:

   

  ·         Experience with stream-processing systems: Storm

  ·         Experience with big data tools: Hadoop, Spark, Kafka, etc.

  ·         Prior SSIS Experience

  ·         Experience in Stream Analytics, Azure Functions, Serverless Architecture, ARM Templates

  ·         Experience in Postgres and Cassandra.

  ·         Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.

  ·         Working knowledge of message queuing, stream processing and highly scalable \'big data\' data stores.

   

About Company :
Purview is a leading Digital Cloud & Data Engineering company headquartered in Edinburgh, United Kingdom having a presence in 14 countries India (Hyderabad, Bangalore, Chennai and Pune), Poland, Germany, Finland, Netherlands, Ireland, USA, UAE, Oman, Singapore, Hong Kong, Malaysia and Australia.

We have a strong presence in UK, Europe and APEC, providing services to Captive Clients (HSBC, NatWest, Northern Trust, IDFC First Bank, Nordia Bank etc) in fully managed solutions and co-managed capacity models. Also, we support various top IT tier 1 organisations (Capgemini, Deloitte, Wipro, Virtusa, L&T, CoForge, TechM and more) to deliver solutions and workforce/resources.

Company Info: