note

Databricks Assistantとは？AIによるSQL自動生成の実力（前編）

近年、生成AIがビジネス現場に急速に浸透しています。文章作成や画像生成だけでなく、データ分析やSQLの自動生成といった領域にもAIの力が活用されはじめました。その代表的な機能として注目を集めているのが Databricks Assistant です。Databricksはデータ ...
note

Databricks Spark SQL徹底最適化② ─ Salting・Join戦略・AQEで高速化を極める

1. データスキュー対策の基本 ─ SaltingとCo-partitioningの考え方 Spark SQLのボトルネックの一つがデータスキュー（データ偏り）です。 特定のキーにデータが集中すると、あるExecutorだけが重い処理を担当し、全体の処理が遅延します。 この問題を解消する代表 ...
TechCrunch

Databricks launches SQL Analytics

AI and data analytics company Databricks today announced the launch of SQL Analytics, a new service that makes it easier for data analysts to run their standard SQL queries directly on data lakes. And ...
InfoWorld

Databricks fires back at Snowflake with SQL-based AI document parsing

Databricks and Snowflake are at it again, and the battleground is now SQL-based document parsing. In an intensifying race to dominate enterprise AI workloads with agent-driven automation, Databricks ...
VentureBeat

Databricks open-sources declarative ETL framework powering 90% faster pipeline builds

Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...
MSN による配信

AI copilots reshape data engineering with new governance focus

AI copilots are accelerating ETL pipeline development, with platforms like Databricks integrating automation, governance, and serverless compute to streamline workflows. While these tools promise ...