TabularTextDataSet
CDIFDataDescription::Classes::TabularTextDataSet
Definition
Documentation
Original
Reference
cdi:TabularTextDataSet
Definition
Definition
Information describing the physical aspects of a data set which is encoded using a text-based method and which has an essentially tabular structure.
Examples
A table formatted as a comma separated values (CSV) file; a pipe-delimited ASCII data file such as the tract definitions for the US 2020 Census (found at https://www2.census.gov/geo/docs/maps-data/data/rel2020/tract/tab20_tract20_tract10_natl.txt); any similar file which used fixed-width columns instead of delimiters.
Explanatory notes
A tabular text data set is a physical description (e.g. unit segment layout) of the instance variables making up the records in the data set. Each instance variable has a text mapping linking it to the physical layout, with a position index supplied by a physical mapping position object. Tabular text data sets are distinct from binary data sets which do not use a text-based encoding, and from more structured text-based data expressed in formats such as XML, JSON, or any of the RDF representations.
CDIF
Definition
DataDownload co-typed as cdi:TabularTextDataSet: delimited or fixed-width text data set (CSV / TSV / fixed-width). Carries CSV-style layout attributes; per-field mappings are TextMapping.
Diagram
Inheritance
Generalizes: AbstractDataSet
Attributes
| Name | Type | Multiplicity | Description |
|---|---|---|---|
| delimiter | string | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-delimiter DefinitionThe Delimiting character in the data. Must be used if isDelimited is True. "The separator between cells, set by the delimiter property of a dialect description. The default is ,. See the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-data-model/#encoding). From the "CSV Dialect" specification (https://specs.frictionlessdata.io/csv-dialect/#specification): "delimiter: specifies a one-character string to use as the field separator. Default = ,." CDIFDefinitionField delimiter (e.g., "," or tab). Scopecsvw:delimiter - field-separator character. |
| isDelimited | boolean | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-isDelimited DefinitionIndicates whether the data are in a delimited format. If "true," the format is delimited, and the isFixedWidth property must be set to "false." If not set to "true," the property isFixedWitdh must be set to "true." CDIFDefinitioncdi:isDelimited - whether the file is delimited. |
| isFixedWidth | boolean | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-isFixedWidth DefinitionSet to true if the file is fixed-width. If true, isDelimited must be set to false. CDIFDefinitioncdi:isFixedWidth - whether the file is fixed-width. |
| hasHeader | boolean | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-hasHeader DefinitionTrue if the file contains a header containing column names. From https://www.w3.org/TR/tabular-metadata/ 5.9 Dialect "header: A boolean atomic property that, if true, sets the header row count flag to 1, and if false to 0, unless headerRowCount is provided, in which case the value provided for the header property is ignored. The default is true." From http://specs.frictionlessdata.io/csv-dialect/ "header: indicates whether the file includes a header row. If true the first row in the file is a header row, not data. Default = true". CDIFDefinitioncdi:hasHeader - whether the file has a header row. |
| headerRowCount | integer | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-headerRowCount DefinitionThe number of lines in the header From https://www.w3.org/TR/tabular-metadata/ 5.9 Dialect "headerRowCount: A numeric atomic property that sets the header row count flag to the single provided value, which MUST be a non-negative integer. The default is 1." CDIFDefinitioncdi:headerRowCount - number of header rows. |
| headerIsCaseSensitive | boolean | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-headerIsCaseSensitive DefinitionIf True, the case of the labels in the header is significant. From the "CSV Dialect" specification (http://specs.frictionlessdata.io/csv-dialect/): "caseSensitiveHeader: indicates that case in the header is meaningful. For example, columns CAT and Cat should not be equated. Default = false." CDIFDefinitioncdi:headerIsCaseSensitive - whether header matching is case-sensitive. |
| lineTerminator | string | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-lineTerminator DefinitionThe strings that can be used at the end of a row, set by the lineTerminators property of a dialect description. The default is [CRLF, LF]. See the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-data-model/#encoding) 5.9 Dialect "lineTerminators: An atomic property that sets the line terminators flag to either an array containing the single provided string value, or the provided array. The default is ['rn', 'n']." Also, from the "CSV Dialect" specification (http://specs.frictionlessdata.io/csv-dialect/): "lineTerminator: specifies the character sequence which should terminate rows. Default = rn." CDIFDefinitionAllowed line terminators, in order (default [CRLF, LF]). Scopecdi:lineTerminator - line terminator characters. |
| quoteCharacter | string | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-quoteCharacter Definition"The string that is used around escaped cells, or null, set by the quoteChar property of a dialect description. The default is ".". See W3C Recommendation "Model for Tabular Data and Metadata on the Web", https://www.w3.org/TR/tabular-data-model/#parsing. From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) 5.9 Dialect: "quoteChar: An atomic property that sets the quote character flag to the single provided value, which MUST be a string or null. If the value is null, the escape character flag is also set to null. The default is '"'." From the CSV Dialect specification (http://specs.frictionlessdata.io/csv-dialect/): "quoteChar: specifies a one-character string to use as the quoting character. Default = "." CDIFDefinitioncdi:quoteCharacter - quote character for quoted values. |
| escapeCharacter | string | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-escapeCharacter Definition"The string that is used to escape the quote character within escaped cells, or null" see https://www.w3.org/TR/tabular-data-model/#encoding. From https://www.w3.org/TR/tabular-metadata/ 5.9 Dialect "doubleQuote: A boolean atomic property that, if true, sets the escape character flag to ". If false, to \. The default is true." From http://specs.frictionlessdata.io/csv-dialect/ "doubleQuote: controls the handling of quotes inside fields. If true, two consecutive quotes should be interpreted as one. Default = true". CDIFDefinitioncdi:escapeCharacter - escape character within quoted values. |
| commentPrefix | string | [0..1] | DocumentationOriginalReferencecdi:commentPrefix CDIFDefinitionCharacter(s) that mark a line as a comment. Scopecdi:commentPrefix - prefix marking a comment line. |
| skipBlankRows | boolean | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-skipBlankRows DefinitionIf the value is True, blank rows are ignored. From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) 5.9 Dialect: "skipBlankRows: A boolean atomic property that sets the skip blank rows flag to the single provided boolean value. The default is false." CDIFDefinitioncdi:skipBlankRows - whether to skip blank rows. |
| skipDataColumns | integer | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-skipDataColumns DefinitionThe number of columns to skip at the beginning of the row. From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) 5.9 Dialect: "skipColumns: A numeric atomic property that sets the skip columns flag to the single provided numeric value, which MUST be a non-negative integer. The default is 0." A value other than 0 will mean that the source numbers of columns will be different from their numbers. CDIFDefinitioncdi:skipDataColumns - number of data columns to skip. |
| skipInitialSpace | boolean | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-skipInitialSpace DefinitionIf the value is True, skip whitespace at the beginning of a line or following a delimiter. From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) 5.9 Dialect: "skipInitialSpace: A boolean atomic property that, if true, sets the trim flag to 'start' and if false, to false. If the trim property is provided, the skipInitialSpace property is ignored. The default is false." From the CSV Dialect specification (http://specs.frictionlessdata.io/csv-dialect/): "skipInitialSpace: specifies how to interpret whitespace which immediately follows a delimiter; if false, it means that whitespace immediately after a delimiter should be treated as part of the following field. Default = true." CDIFDefinitioncdi:skipInitialSpace - whether to skip initial whitespace. |
| skipRows | integer | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-skipRows DefinitionNumber of input rows to skip preceding the header or data. From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) 5.9 Dialect: "skipRows: A numeric atomic property that sets the skip rows flag to the single provided numeric value, which MUST be a non-negative integer. The default is 0." A value greater than 0 will mean that the source numbers of rows will be different from their numbers. CDIFDefinitioncdi:skipRows - number of leading rows to skip. |
| treatConsecutiveDelimitersAsOne | boolean | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-treatConsecutiveDelimitersAsOne DefinitionIf the value is True, consecutive (adjacent) delimiters are treated as a single delimiter; if the value is False consecutive (adjacent) delimiters indicate a missing value. CDIFDefinitioncdi:treatConsecutiveDelimitersAsOne - whether consecutive delimiters collapse. |
| trim | string | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-trim DefinitionSpecifies which spaces to remove from a data value (start, end, both, neither) From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) 5.9 Dialect: "trim: An atomic property that, if the boolean true, sets the trim flag to true and if the boolean false to false. If the value provided is a string, sets the trim flag to the provided value, which MUST be one of 'true', 'false', 'start', or 'end'. The default is true." CDIFDefinitionWhich spaces to remove from a data value (DDI-CDI TabularTextDataSet.trim, TrimValues enumeration). Scopecdi:trim - whitespace-trimming mode. |
| tableDirection | string | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-tableDirection DefinitionIndicates the direction in which columns are arranged in each row. From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) 5.3.2: "tableDirection: An atomic property that MUST have a single string value that is one of 'rtl', 'ltr', or 'auto'. Indicates whether the tables in the group should be displayed with the first column on the right, on the left, or based on the first character in the table that has a specific direction. The value of this property becomes the value of the table direction annotation for all the tables in the table group. See Bidirectional Tables in [tabular-data-model] for details. The default value for this property is 'auto'." CDIFDefinitionDirection in which columns are arranged in each row (DDI-CDI TabularTextDataSet.tableDirection, TableDirectionValues enumeration). Scopecdi:tableDirection - row / column primary direction. |
| textDirection | string | [0..1] | DocumentationOriginalReferencecdi:TabularTextDataSet-textDirection DefinitionIndicates the reading order of text within cells. From the W3C Recommendation "Metadata Vocabulary for Tabular Data" (https://www.w3.org/TR/tabular-metadata/) Inherited 5.7: "textDirection: An atomic property that MUST have a single string value that is one of 'ltr', 'rtl', 'auto' or 'inherit' (the default). Indicates whether the text within cells should be displayed as left-to-right text (ltr), as right-to-left text (rtl), according to the content of the cell (auto) or in the direction inherited from the table direction annotation of the table. The value of this property determines the text direction annotation for the column, and the text direction annotation for the cells within that column: if the value is inherit then the value of the text direction annotation is the value of the table direction annotation on the table, otherwise it is the value of this property. See Bidirectional Tables in [tabular-data-model] for details." CDIFDefinitionReading order of text within cells (DDI-CDI TabularTextDataSet.textDirection, TextDirectionValues enumeration). Scopecdi:textDirection - text direction (ltr / rtl / ...). |
Associations
No associations.