DEV Community

Mike Houngbadji
Mike Houngbadji

Posted on • Updated on

Apache Spark SQL: CTAS USING CSV with specific delimiter

#sql #spark #database #tips

To use CTAS (Create table as Select) in Apache Spark with a specific delimiter using the OPTION syntax:

CREATE TABLE sample_table
USING CSV
OPTIONS ('delimiter'='|')
AS
SELECT ....
Enter fullscreen mode Exit fullscreen mode

SparkSQL Documentation

PS:
I wrote this to also help myself retrieve the solution faster.

Top comments (0)

Read next

congcong profile image

Introduction to Control Flow Functions in GBase 8a MPP Cluster

Cong Li -

franckpachot profile image

PostgreSQL Semi Join, Unique-ify RHS, Materialized CTEs, and Rows Estimation

Franck Pachot -

dheerajgopi profile image

Building key-value storage for a Redis clone

Dheeraj Gopinath -

jacobandrewsky profile image

Improving Performance of PostgreSQL queries

Jakub Andrzejewski -