Product Feedback

  • Hot ideas
  • Top ideas
  • New ideas
  • My feedback
  1. Write to S3 using Server Side Encryption

    We need to store some data in an encrypted form. We normally use S3's SSE. It seems that we cannot write from Spark to S3 using SSE. Supporting that would be helpful.

    9 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Facebook Google
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Data import / export  ·  Flag idea as inappropriate…  ·  Admin →

    This feature is now finished. We support SSE-S3 and SSE-KMS. This is available in Databricks 2.2, which is going out in this/next week. One can mount directories using dbutils.fs.mount by specifying the desired SSE-based encryption method.

  2. Create Table: Add ability to preview varying data formats - JSON etc

    Expand the potential number of file types that can be imported via the web UI when creating a table e.g. JSON. Currently it appears to be text delimited files only.

    1 vote
    Vote
    Sign in
    (thinking…)
    Sign in with: Facebook Google
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Data import / export  ·  Flag idea as inappropriate…  ·  Admin →
  3. 4 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Facebook Google
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    0 comments  ·  Data import / export  ·  Flag idea as inappropriate…  ·  Admin →
  4. Create Table: Add support for column headers in the first row

    I have a large CSV file with column headers in the first row. When I try to import it as a table all my columns are of type "STRING" and my first row contains headers.

    Would be good to be able to specify that first line in a text file contains column names.

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Facebook Google
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    completed  ·  2 comments  ·  Data import / export  ·  Flag idea as inappropriate…  ·  Admin →
  5. Create Table from CSV: Handle quoting of fields like strings

    CSV files often use quotes to protect embedded commas and the like.
    Please provide an option to do quote processing.

    See for example:
    http://en.wikipedia.org/wiki/Comma-separated_values#Basic_rules_and_examples

    2 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Facebook Google
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    1 comment  ·  Data import / export  ·  Flag idea as inappropriate…  ·  Admin →
  6. Import data from other sources

    Support importing data from external databases, similar to the way one could import s3 buckets - I would personally love support for MongoDB and other NoSQL stores. I'd also consider making it easy to fetch data from Freebase etc.

    4 votes
    Vote
    Sign in
    (thinking…)
    Sign in with: Facebook Google
    Signed in as (Sign out)
    You have left! (?) (thinking…)
    completed  ·  2 comments  ·  Data import / export  ·  Flag idea as inappropriate…  ·  Admin →
  • Don't see your idea?

Feedback and Knowledge Base