Using LLMs to build neural optimizers, neural scheduling systems, and neural workload tuners. Applying ML to make data warehouses and Spark jobs more efficient. Hiring staff ML engineers to train models that predict compute needs, scaling behavior, …

We use ML to make data warehouses and spark jobs more efficient. We're hiring staff ML engineers to train models that can understand how much compute a job needs, how it scales to larger machines, whether a machine can run more jobs, and so on; and …

Wir bei control-f sind echte Daten-Nerds und bauen Big Data Plattformen für Telemetriedaten in der Industrie. Wir suchen jemanden, der Lust hat, mit uns gemeinsam aus Daten-Chaos smarte Lösungen zu machen. Wenn du Spaß daran hast, mit PySpark und Da…

We have an open headcount on my team at Databricks (Compute Lifecycle) for a senior or staff engineer! Typically this means 5+ years of experience. For this role, we're also looking for experience with distributed systems (and ideally experience run…

Amazon Elastic MapReduce (EMR) is the industry-leading cloud big data platform for petabyte-scale data processing, interactive analytics, and machine learning using open-source frameworks such as Apache Spark, Apache Hive, Presto and HBase. Amazon A…

Utiligize is looking for a Senior Data Engineer to solve one of the most difficult problems in decarbonization: building out power system infrastructure to support huge increases in electricity demand and production. You will take on development of …