Package com.google.cloud.bigquery
Class LoadJobConfiguration
- java.lang.Object
-
- com.google.cloud.bigquery.JobConfiguration
-
- com.google.cloud.bigquery.LoadJobConfiguration
-
- All Implemented Interfaces:
LoadConfiguration,Serializable
public final class LoadJobConfiguration extends JobConfiguration implements LoadConfiguration
Google BigQuery load job configuration. A load job loads data from one of several formats into a table. Data is provided as URIs that point to objects in Google Cloud Storage. Load job configurations haveJobConfiguration.Type.LOADtype.- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classLoadJobConfiguration.Builder-
Nested classes/interfaces inherited from class com.google.cloud.bigquery.JobConfiguration
JobConfiguration.Type
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description static LoadJobConfiguration.Builderbuilder(TableId destinationTable, String sourceUri)Creates a builder for a BigQuery Load Job configuration given the destination table and source URI.booleanequals(Object obj)BooleangetAutodetect()[Experimental] Returns whether automatic inference of the options and schema for CSV and JSON sources is set.ClusteringgetClustering()Returns the clustering specification for the definition table.List<ConnectionProperty>getConnectionProperties()JobInfo.CreateDispositiongetCreateDisposition()Returns whether the job is allowed to create new tables.BooleangetCreateSession()CsvOptionsgetCsvOptions()Returns additional properties used to parse CSV data (used whenLoadConfiguration.getFormat()is set to CSV).DatastoreBackupOptionsgetDatastoreBackupOptions()Returns additional options used to load from a Cloud datastore backup.List<String>getDecimalTargetTypes()Returns the list of possible SQL data types to which the source decimal values are converted.EncryptionConfigurationgetDestinationEncryptionConfiguration()TableIdgetDestinationTable()Returns the destination table to load the data into.StringgetFormat()Returns the format of the data files.HivePartitioningOptionsgetHivePartitioningOptions()LonggetJobTimeoutMs()Returns the timeout associated with this jobMap<String,String>getLabels()Returns the labels associated with this jobIntegergetMaxBadRecords()Returns the maximum number of bad records that BigQuery can ignore when running the job.StringgetNullMarker()Returns the string that represents a null value in a CSV file.ParquetOptionsgetParquetOptions()RangePartitioninggetRangePartitioning()Returns the range partitioning specification for the tableStringgetReferenceFileSchemaUri()SchemagetSchema()Returns the schema for the destination table, if set.List<JobInfo.SchemaUpdateOption>getSchemaUpdateOptions()[Experimental] Returns options allowing the schema of the destination table to be updated as a side effect of the load job.List<String>getSourceUris()Returns the fully-qualified URIs that point to source data in Google Cloud Storage (e.g.TimePartitioninggetTimePartitioning()Returns the time partitioning specification defined for the destination table.BooleangetUseAvroLogicalTypes()Returns True/False.JobInfo.WriteDispositiongetWriteDisposition()Returns the action that should occur if the destination table already exists.inthashCode()BooleanignoreUnknownValues()Returns whether BigQuery should allow extra values that are not represented in the table schema.static LoadJobConfiguration.BuildernewBuilder(TableId destinationTable, String sourceUri)Creates a builder for a BigQuery Load Job configuration given the destination table and source URI.static LoadJobConfiguration.BuildernewBuilder(TableId destinationTable, String sourceUri, FormatOptions format)Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URI.static LoadJobConfiguration.BuildernewBuilder(TableId destinationTable, List<String> sourceUris)Creates a builder for a BigQuery Load Job configuration given the destination table and source URIs.static LoadJobConfiguration.BuildernewBuilder(TableId destinationTable, List<String> sourceUris, FormatOptions format)Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URIs.static LoadJobConfigurationof(TableId destinationTable, String sourceUri)Returns a BigQuery Load Job Configuration for the given destination table and source URI.static LoadJobConfigurationof(TableId destinationTable, String sourceUri, FormatOptions format)Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.static LoadJobConfigurationof(TableId destinationTable, List<String> sourceUris)Returns a BigQuery Load Job Configuration for the given destination table and source URIs.static LoadJobConfigurationof(TableId destinationTable, List<String> sourceUris, FormatOptions format)Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.LoadJobConfiguration.BuildertoBuilder()Returns a builder for the object.-
Methods inherited from class com.google.cloud.bigquery.JobConfiguration
getType, toString
-
-
-
-
Method Detail
-
getDestinationTable
public TableId getDestinationTable()
Description copied from interface:LoadConfigurationReturns the destination table to load the data into.- Specified by:
getDestinationTablein interfaceLoadConfiguration
-
getDestinationEncryptionConfiguration
public EncryptionConfiguration getDestinationEncryptionConfiguration()
- Specified by:
getDestinationEncryptionConfigurationin interfaceLoadConfiguration
-
getCreateDisposition
public JobInfo.CreateDisposition getCreateDisposition()
Description copied from interface:LoadConfigurationReturns whether the job is allowed to create new tables.- Specified by:
getCreateDispositionin interfaceLoadConfiguration- See Also:
- Create Disposition
-
getWriteDisposition
public JobInfo.WriteDisposition getWriteDisposition()
Description copied from interface:LoadConfigurationReturns the action that should occur if the destination table already exists.- Specified by:
getWriteDispositionin interfaceLoadConfiguration- See Also:
- Write Disposition
-
getNullMarker
public String getNullMarker()
Description copied from interface:LoadConfigurationReturns the string that represents a null value in a CSV file.- Specified by:
getNullMarkerin interfaceLoadConfiguration- See Also:
- Null Marker
-
getCsvOptions
public CsvOptions getCsvOptions()
Description copied from interface:LoadConfigurationReturns additional properties used to parse CSV data (used whenLoadConfiguration.getFormat()is set to CSV). Returnsnullif not set.- Specified by:
getCsvOptionsin interfaceLoadConfiguration
-
getParquetOptions
public ParquetOptions getParquetOptions()
-
getDatastoreBackupOptions
public DatastoreBackupOptions getDatastoreBackupOptions()
Description copied from interface:LoadConfigurationReturns additional options used to load from a Cloud datastore backup.- Specified by:
getDatastoreBackupOptionsin interfaceLoadConfiguration
-
getFormat
public String getFormat()
Description copied from interface:LoadConfigurationReturns the format of the data files.- Specified by:
getFormatin interfaceLoadConfiguration
-
getMaxBadRecords
public Integer getMaxBadRecords()
Description copied from interface:LoadConfigurationReturns the maximum number of bad records that BigQuery can ignore when running the job. If the number of bad records exceeds this value, an invalid error is returned in the job result. By default no bad record is ignored.- Specified by:
getMaxBadRecordsin interfaceLoadConfiguration
-
getSchema
public Schema getSchema()
Description copied from interface:LoadConfigurationReturns the schema for the destination table, if set. Returnsnullotherwise.- Specified by:
getSchemain interfaceLoadConfiguration
-
ignoreUnknownValues
public Boolean ignoreUnknownValues()
Description copied from interface:LoadConfigurationReturns whether BigQuery should allow extra values that are not represented in the table schema. Iftrue, the extra values are ignored. Iftrue, records with extra columns are treated as bad records, and if there are too many bad records, an invalid error is returned in the job result. By default unknown values are not allowed.- Specified by:
ignoreUnknownValuesin interfaceLoadConfiguration
-
getSourceUris
public List<String> getSourceUris()
Returns the fully-qualified URIs that point to source data in Google Cloud Storage (e.g. gs://bucket/path). Each URI can contain one '*' wildcard character and it must come after the 'bucket' name.
-
getDecimalTargetTypes
public List<String> getDecimalTargetTypes()
Description copied from interface:LoadConfigurationReturns the list of possible SQL data types to which the source decimal values are converted. This list and the precision and the scale parameters of the decimal field determine the target type. In the order of NUMERIC, BIGNUMERIC, and STRING, a type is picked if it is in the specified list and if it supports the precision and the scale. STRING supports all precision and scale values.- Specified by:
getDecimalTargetTypesin interfaceLoadConfiguration
-
getAutodetect
public Boolean getAutodetect()
Description copied from interface:LoadConfiguration[Experimental] Returns whether automatic inference of the options and schema for CSV and JSON sources is set.- Specified by:
getAutodetectin interfaceLoadConfiguration
-
getTimePartitioning
public TimePartitioning getTimePartitioning()
Description copied from interface:LoadConfigurationReturns the time partitioning specification defined for the destination table.- Specified by:
getTimePartitioningin interfaceLoadConfiguration
-
getClustering
public Clustering getClustering()
Description copied from interface:LoadConfigurationReturns the clustering specification for the definition table.- Specified by:
getClusteringin interfaceLoadConfiguration
-
getUseAvroLogicalTypes
public Boolean getUseAvroLogicalTypes()
Description copied from interface:LoadConfigurationReturns True/False. Indicates whether the logical type is interpreted.- Specified by:
getUseAvroLogicalTypesin interfaceLoadConfiguration
-
getSchemaUpdateOptions
public List<JobInfo.SchemaUpdateOption> getSchemaUpdateOptions()
Description copied from interface:LoadConfiguration[Experimental] Returns options allowing the schema of the destination table to be updated as a side effect of the load job. Schema update options are supported in two cases: when writeDisposition is WRITE_APPEND; when writeDisposition is WRITE_TRUNCATE and the destination table is a partition of a table, specified by partition decorators. For normal tables, WRITE_TRUNCATE will always overwrite the schema.- Specified by:
getSchemaUpdateOptionsin interfaceLoadConfiguration
-
getJobTimeoutMs
public Long getJobTimeoutMs()
Returns the timeout associated with this job
-
getRangePartitioning
public RangePartitioning getRangePartitioning()
Returns the range partitioning specification for the table
-
getHivePartitioningOptions
public HivePartitioningOptions getHivePartitioningOptions()
-
getReferenceFileSchemaUri
public String getReferenceFileSchemaUri()
-
getConnectionProperties
public List<ConnectionProperty> getConnectionProperties()
-
getCreateSession
public Boolean getCreateSession()
-
toBuilder
public LoadJobConfiguration.Builder toBuilder()
Description copied from class:JobConfigurationReturns a builder for the object.- Specified by:
toBuilderin interfaceLoadConfiguration- Specified by:
toBuilderin classJobConfiguration
-
newBuilder
public static LoadJobConfiguration.Builder newBuilder(TableId destinationTable, List<String> sourceUris)
Creates a builder for a BigQuery Load Job configuration given the destination table and source URIs.
-
builder
public static LoadJobConfiguration.Builder builder(TableId destinationTable, String sourceUri)
Creates a builder for a BigQuery Load Job configuration given the destination table and source URI.
-
newBuilder
public static LoadJobConfiguration.Builder newBuilder(TableId destinationTable, String sourceUri)
Creates a builder for a BigQuery Load Job configuration given the destination table and source URI.
-
newBuilder
public static LoadJobConfiguration.Builder newBuilder(TableId destinationTable, List<String> sourceUris, FormatOptions format)
Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URIs.
-
newBuilder
public static LoadJobConfiguration.Builder newBuilder(TableId destinationTable, String sourceUri, FormatOptions format)
Creates a builder for a BigQuery Load Job configuration given the destination table, format and source URI.
-
of
public static LoadJobConfiguration of(TableId destinationTable, List<String> sourceUris)
Returns a BigQuery Load Job Configuration for the given destination table and source URIs.
-
of
public static LoadJobConfiguration of(TableId destinationTable, String sourceUri)
Returns a BigQuery Load Job Configuration for the given destination table and source URI.
-
of
public static LoadJobConfiguration of(TableId destinationTable, List<String> sourceUris, FormatOptions format)
Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.
-
of
public static LoadJobConfiguration of(TableId destinationTable, String sourceUri, FormatOptions format)
Returns a BigQuery Load Job Configuration for the given destination table, format and source URI.
-
-