Comma Separated Value (CSV)

Note:  No authentication connection is needed to set up CSV connectors, as it reads from the local filesystem. CSV cannot be used as an output connector nor a Content Service Connection.


Discovery Connector

Viewing the discovery schema instances will show you a table of all available Discovery Instances, this table can be sorted by Name, Type, and Collection.

Discovery Instance Fields

  • Name: Instance Name

  • Ignore Types: List of types to ignore, not used for CSV

  • CSV File Path: Full path to the CSV File.

  • CSV Type: If blank, the type on the fields will be csv file name with periods replaced with '_'


Integration Connection

The CSV (Comma Separated Values ) connection is an integration connector that can merge metadata stored in a csv file with external binaries from a filesystem. The binaries are optional depending on configuration.

Integration Connection Fields

  • Connection Name: This is a unique name given to the connector instance upon creation.

  • Description: A description of the connector to help identify it better.


Job Configuration

Repository Connection Configuration

All of these fields will appear in a Job Specification where the CSV connector is the repository.

CSV File Info

  • CSV File Path: Path to the CSV file

  • CSV Type: CSV Type. Will be prepended to all properties. If blank, the type will be the (filename)_csv

  • Separator Character: The character that separates each field value, also called a delimiter. Default is comma (,)

  • Escape Character: The value used to escape values such as slashes and quotes. Default is backslash (\)

  • Quote Character: The character used to denote fields. Default is double quotes (")

  • Document Type: Sets the base type for the migrated files to either documents or folders

  • Maximum number of rows: Including the header. Set to 0 or leave blank to read the entire csv

  • Check For Timestamp: Check if the created and modified dates are a 10 or 13 digit timestamp. Convert them to the configured format if present.

  • Fail on Missing Content: If including content, fail a document if the supplied file path from the row does not lead to the file content

File Field Mapping

  • Path Field: The header under which file paths are stored

  • Path Includes Files: If checked, 3Sixty will extract the filename from the value found in the Path Field. Only checked if Path Field is populated

  • File Field: The header under which file names are stored

  • Id Field: Field which contains the source document Id. If blank, the id will be (csvfilepath):(row)

  • Created Date Field: The field that stores the date the file was created

  • File Length Field: The field that stores the file length

  • Modified Date Field: The field that stores the date the file was modified

  • Path to Files: If set, the connector will prepend this to the file path and search for a file at that location. Include Binaries must also be checked


API Keys

CSV Connector: Read=true: Write=false: MIP=false

Repo (Read) Specs

Key

Description

Data Type

filepath CSV File Path If set, will be used to set the parent path. Otherwise parent path will be /"" String

csvtype

CSV Type. Will be prepended to all properties. If blank, the type will be the [filename]_csv.

String

separatorchar

Separator Character

String

escapechar

Escape Character

String

quotechar

Quote Character

String

filetypefield

Document Type Sets the base type for the migrated documents

String

maxrows

Maximum number of rows, including the header. Set to 0 or leave blank to read the entire csv.

Integer

pathfield

Path Field The field that contains the absolute path to a file. If present will be used to set the parent path

String

pathincludesfiles

Path Includes Files If true and Path Field is not empty, 3Sixty will attempt to extract the file name from the path

Boolean

filefield

File Field If set, the field will be used to set the file name.

String

idField

Field which contains the source document Id. If blank, the id will be [csvfilepath] [row]

String

datecreatedfield

Created Date Field

String

datemodifiedfield

Modified Date Field

String

csvDateTimeFormat

Date format for Created and Modified fields. Uses java date formats.

String

checkFormTimestamp

Check if the created and modified dates are a 10 or 13 digit timestamp. Convert them to the configured format if present.

Boolean

filelengthfield

File Length Field The field which contains file length metadata.

String

pathtofiles

Path To Files If set, the connector will prepend this to the file path and search for a file at that location.

String

failMissingContent

If including content, fail a document if the supplied file path from the row does not lead to the file content

Boolean


Looking to integrate with CSV data? We can help.