Získajte nové pracovné ponuky na email
- Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most ...Vzdialená práca
2700 - 4500 €
...applications for Swiss Re. The team builds on a lakehouse architecture using Azure Databricks, Azure Data Factory and Azure Data Lake (Delta Lake) with Python being the main programming language and PySpark is used for large scale data engineering. About You You're a...3800 €
...Experience coordinating UAT, releases, and performance/security validation. Nice-to-Have: Hands-on with Databricks, Apache Spark, Delta Lake. Understanding of regulatory reporting and risk frameworks. Familiarity with insurance data, risk modeling, or exposure...3800 - 6300 €
...applications for Swiss Re. The team builds on a lakehouse architecture using Azure Databricks, Azure Data Factory and Azure Data Lake (Delta Lake) with Python being the main programming language and PySpark is used for large scale data engineering. About You You're a...- ...Spark/PySpark, for simplified data access and governance. Secure integration solutions and enhanced data quality monitoring, utilizing Delta Live Table tests, established trust in the platform. The intermediate result is a user-friendly, secure, and data-driven platform,...Vzdialená práca
- ...design Experience with Azure Synapse (especially Synapse Serverless and Synapse Pipelines) Strong expertise in Databricks: DLT (Delta Live Tables), Workflows, workspace administration Ability to design Data Lakehouse architecture and familiarity with Medallion Architecture...Vzdialená práca
- ...and Python with practical experience in data engineering and analytics workloads on Databricks Strongly experienced with Databricks (Delta Lake, Unity Catalog, Workflows, Jobs, SQL Warehouses) Azure Data Lake Storage Gen2 (ADLS Gen2) Azure Data Factory / Microsoft Fabric,...Vzdialená práca
- ...YOUR PROFILE Hands-on experience designing and developing data pipelines with Databricks. Strong working knowledge of Delta Lake, Spark, and Databricks notebooks. Proficiency in SQL and Python for data transformation and analysis. Familiarity with data modeling...
- ...Working on Real-Time Streaming Data Platform (Java & Apache Spark). Tech stack: Apache Spark on Azure Databricks Apache Kafka Delta Lake Java MS SQL Server and NoSQL storages like Elastic Search, Redis, Azure Data Explorer Docker containers Azure DevOps...Vzdialená práca
- ...needs into actionable insights Strong verbal and written English communication skills Nice to have: Databricks, familiarity with Delta Lake / Medallion Architecture Monitoring/logging tools (Azure Monitor, Log Analytics) At Godel Technologies, we are passionate...
- ...sa meglévő adatlandscape elemzése alapján, Adatmodellek, sémák és tárolási minták definiálása (dimenzionális, normalizált, lakehouse, delta/parquet alapú megoldások), Batch és streaming adatbetöltési folyamatok megtervezése (pl. Kafka, Event Hubs vagy egyenértékű technológi...
- ...energy generation and consumption. We work with always up-to-date versions of: Apache Spark on Azure Databricks Apache Kafka Delta Lake Java MS SQL Server and NoSQL storages like Elastic Search, Redis, Azure Data Explorer Docker containers Azure DevOps...Vzdialená práca
- ...Multisport, Warta Insurance, training platform (Sages) ,[Design and develop ETL/ELT processes using Microsoft Fabric, Work with Lakehouse (Delta/Parquet, OneLake) and Synapse/Data Warehouse, Build and optimize pipelines in Data Factory (orchestration, scheduling), Support...
- ...Architect Professional, Azure Certified Solutions Architect Expert, lub IBM certifications Znajomość architektury typu „data lakehouse” (Delta Lake, Apache Iceberg) Podstawowe zrozumienie Kubernetesa / konteneryzacji (Docker) – jeśli architektura obejmuje potoki uczenia...
- ...Spark pipelines in PySpark or Scala ~ Practical experience with Spark Streaming for low-latency pipelines ~ Familiarity with Delta Lake and modern data lakehouse architectures ~ Hands-on experience with Kubernetes and container orchestration ~ Experience...
- ...Posiadasz ekspercką znajomość PySpark Zaawansowana znajomość Spark SQL. Praktyczna znajomość Delta Lake (Delta tables, Z-Ordering, OPTIMIZE, VACUUM, Time Travel). Doświadczenie z Azure DevOps, pipelines CI/CD. Bardzo dobra znajomość Git, w tym branching strategies...Vzdialená práca
- ...processing: Apache Spark, Databricks, Kafka, Flink Cloud data warehouses and lakes: Snowflake, BigQuery, Redshift, Azure Synapse, Delta Lake Exposure to enterprise platforms (ServiceNow, Salesforce, SAP, procurement systems, or similar) Experience with containerization...
- ...At least 5 years of experience in data engineering architecture, with: Minimum 5 years of hands-on experience with Databricks & Delta Lake on Azure services. Proven expertise in migrating from traditional data warehouse solutions to modern data platforms like Lakehouse...
- ...,[Develop and maintain data delivery pipelines for a leading IT solution in the energy market, leveraging Apache Spark, Databricks, Delta Lake, and Python. , Have end-to-end responsibility for the full lifecycle of features you develop. , Design technical solutions for business...Vzdialená práca
- ...Optimize Spark workloads by applying join strategies, shuffle optimization, caching, and partitioning techniques , Design and maintain Delta Lake architectures, including schema evolution, ACID transactions, and performance tuning , Implement data governance and access...
