Azure Data Engineer

Company: Outdefine
Location: San Francisco
Posted on: October 4, 2024

Job Description:

As a skilled professional seeking career growth, you deserve access to the best job opportunities available. Join Outdefine's Trusted community today and apply to premier job openings with leading enterprises globally. Set your own rate, keep all your pay, and enjoy the benefits of a fee-free experience. Azure Data Engineer Outdefine Partner Web3 10-50 San Francisco, CA, USA Apply Now About the jobOverview:About the Role:We are seeking a skilled Azure Databricks Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and implementing big data solutions using Azure Databricks. You will collaborate with data scientists, analysts, and other stakeholders to ensure efficient data processing, transformation, and analysis.Key Responsibilities:Design and implement data pipelines and workflows using Azure Databricks.Develop and optimize Spark applications for data processing and analysis.Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics.Perform data ingestion, cleansing, and transformation tasks.Monitor and troubleshoot performance issues in data pipelines.Collaborate with data scientists and analysts to understand data requirements and deliver appropriate solutions.Ensure data security and compliance with industry standards and best practices.Document technical solutions and processes.Qualifications:Bachelor's degree in Computer Science, Engineering, or related field.Proven experience with Azure Databricks and Apache Spark.Strong knowledge of Azure cloud services and architecture.Proficiency in programming languages such as Python, Scala, or SQL.Experience with big data technologies and data warehousing concepts.Familiarity with data modeling and ETL processes.Excellent problem-solving and analytical skills.Strong communication and teamwork abilities.Preferred Qualifications:Azure certifications (e.g., Azure Data Engineer Associate).Experience with CI/CD tools and practices.Knowledge of machine learning and data science concepts.Familiarity with other big data platforms such as Hadoop or Kafka. Skills required Azure Databricks Data structures Employee location Skills required Azure Databricks Data structures Employee location San Francisco, CA, USA Experience level Not specified Workplace type remote Job type full time contract Compensation $60 - 70 /hr Currency USD Become a trusted member, apply to jobs, and earn token rewards Create a profileCreate and customize your member profile. Complete assessmentEarn 500 Outdefine tokens for becoming trusted member and completing your assessment. Apply for jobsOnce you are a Trusted Member you can start applying to jobs.
#J-18808-Ljbffr

Keywords: Outdefine, San Rafael , Azure Data Engineer, Engineering , San Francisco, California