Class InputDataConfig
- java.lang.Object
-
- com.google.protobuf.AbstractMessageLite
-
- com.google.protobuf.AbstractMessage
-
- com.google.protobuf.GeneratedMessageV3
-
- com.google.cloud.aiplatform.v1beta1.InputDataConfig
-
- All Implemented Interfaces:
InputDataConfigOrBuilder,com.google.protobuf.Message,com.google.protobuf.MessageLite,com.google.protobuf.MessageLiteOrBuilder,com.google.protobuf.MessageOrBuilder,Serializable
public final class InputDataConfig extends com.google.protobuf.GeneratedMessageV3 implements InputDataConfigOrBuilder
Specifies Vertex AI owned input data to be used for training, and possibly evaluating, the Model.
Protobuf typegoogle.cloud.aiplatform.v1beta1.InputDataConfig- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classInputDataConfig.BuilderSpecifies Vertex AI owned input data to be used for training, and possibly evaluating, the Model.static classInputDataConfig.DestinationCasestatic classInputDataConfig.SplitCase-
Nested classes/interfaces inherited from class com.google.protobuf.GeneratedMessageV3
com.google.protobuf.GeneratedMessageV3.BuilderParent, com.google.protobuf.GeneratedMessageV3.ExtendableBuilder<MessageT extends com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT>,BuilderT extends com.google.protobuf.GeneratedMessageV3.ExtendableBuilder<MessageT,BuilderT>>, com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT extends com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessageV3.ExtendableMessageOrBuilder<MessageT extends com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessageV3.FieldAccessorTable, com.google.protobuf.GeneratedMessageV3.UnusedPrivateParameter
-
-
Field Summary
Fields Modifier and Type Field Description static intANNOTATION_SCHEMA_URI_FIELD_NUMBERstatic intANNOTATIONS_FILTER_FIELD_NUMBERstatic intBIGQUERY_DESTINATION_FIELD_NUMBERstatic intDATASET_ID_FIELD_NUMBERstatic intFILTER_SPLIT_FIELD_NUMBERstatic intFRACTION_SPLIT_FIELD_NUMBERstatic intGCS_DESTINATION_FIELD_NUMBERstatic intPERSIST_ML_USE_ASSIGNMENT_FIELD_NUMBERstatic intPREDEFINED_SPLIT_FIELD_NUMBERstatic intSAVED_QUERY_ID_FIELD_NUMBERstatic intSTRATIFIED_SPLIT_FIELD_NUMBERstatic intTIMESTAMP_SPLIT_FIELD_NUMBER
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description booleanequals(Object obj)StringgetAnnotationSchemaUri()Applicable only to custom training with Datasets that have DataItems and Annotations.com.google.protobuf.ByteStringgetAnnotationSchemaUriBytes()Applicable only to custom training with Datasets that have DataItems and Annotations.StringgetAnnotationsFilter()Applicable only to Datasets that have DataItems and Annotations.com.google.protobuf.ByteStringgetAnnotationsFilterBytes()Applicable only to Datasets that have DataItems and Annotations.BigQueryDestinationgetBigqueryDestination()Only applicable to custom training with tabular Dataset with BigQuery source.BigQueryDestinationOrBuildergetBigqueryDestinationOrBuilder()Only applicable to custom training with tabular Dataset with BigQuery source.StringgetDatasetId()Required.com.google.protobuf.ByteStringgetDatasetIdBytes()Required.static InputDataConfiggetDefaultInstance()InputDataConfiggetDefaultInstanceForType()static com.google.protobuf.Descriptors.DescriptorgetDescriptor()InputDataConfig.DestinationCasegetDestinationCase()FilterSplitgetFilterSplit()Split based on the provided filters for each set.FilterSplitOrBuildergetFilterSplitOrBuilder()Split based on the provided filters for each set.FractionSplitgetFractionSplit()Split based on fractions defining the size of each set.FractionSplitOrBuildergetFractionSplitOrBuilder()Split based on fractions defining the size of each set.GcsDestinationgetGcsDestination()The Cloud Storage location where the training data is to be written to.GcsDestinationOrBuildergetGcsDestinationOrBuilder()The Cloud Storage location where the training data is to be written to.com.google.protobuf.Parser<InputDataConfig>getParserForType()booleangetPersistMlUseAssignment()Whether to persist the ML use assignment to data item system labels.PredefinedSplitgetPredefinedSplit()Supported only for tabular Datasets.PredefinedSplitOrBuildergetPredefinedSplitOrBuilder()Supported only for tabular Datasets.StringgetSavedQueryId()Only applicable to Datasets that have SavedQueries.com.google.protobuf.ByteStringgetSavedQueryIdBytes()Only applicable to Datasets that have SavedQueries.intgetSerializedSize()InputDataConfig.SplitCasegetSplitCase()StratifiedSplitgetStratifiedSplit()Supported only for tabular Datasets.StratifiedSplitOrBuildergetStratifiedSplitOrBuilder()Supported only for tabular Datasets.TimestampSplitgetTimestampSplit()Supported only for tabular Datasets.TimestampSplitOrBuildergetTimestampSplitOrBuilder()Supported only for tabular Datasets.booleanhasBigqueryDestination()Only applicable to custom training with tabular Dataset with BigQuery source.booleanhasFilterSplit()Split based on the provided filters for each set.booleanhasFractionSplit()Split based on fractions defining the size of each set.booleanhasGcsDestination()The Cloud Storage location where the training data is to be written to.inthashCode()booleanhasPredefinedSplit()Supported only for tabular Datasets.booleanhasStratifiedSplit()Supported only for tabular Datasets.booleanhasTimestampSplit()Supported only for tabular Datasets.protected com.google.protobuf.GeneratedMessageV3.FieldAccessorTableinternalGetFieldAccessorTable()booleanisInitialized()static InputDataConfig.BuildernewBuilder()static InputDataConfig.BuildernewBuilder(InputDataConfig prototype)InputDataConfig.BuildernewBuilderForType()protected InputDataConfig.BuildernewBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent)protected ObjectnewInstance(com.google.protobuf.GeneratedMessageV3.UnusedPrivateParameter unused)static InputDataConfigparseDelimitedFrom(InputStream input)static InputDataConfigparseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry)static InputDataConfigparseFrom(byte[] data)static InputDataConfigparseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry)static InputDataConfigparseFrom(com.google.protobuf.ByteString data)static InputDataConfigparseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry)static InputDataConfigparseFrom(com.google.protobuf.CodedInputStream input)static InputDataConfigparseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry)static InputDataConfigparseFrom(InputStream input)static InputDataConfigparseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry)static InputDataConfigparseFrom(ByteBuffer data)static InputDataConfigparseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry)static com.google.protobuf.Parser<InputDataConfig>parser()InputDataConfig.BuildertoBuilder()voidwriteTo(com.google.protobuf.CodedOutputStream output)-
Methods inherited from class com.google.protobuf.GeneratedMessageV3
canUseUnsafe, computeStringSize, computeStringSizeNoTag, emptyBooleanList, emptyDoubleList, emptyFloatList, emptyIntList, emptyLongList, getAllFields, getDescriptorForType, getField, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof, internalGetMapField, isStringEmpty, makeExtensionsImmutable, makeMutableCopy, mergeFromAndMakeImmutableInternal, mutableCopy, mutableCopy, mutableCopy, mutableCopy, mutableCopy, newBooleanList, newBuilderForType, newDoubleList, newFloatList, newIntList, newLongList, parseDelimitedWithIOException, parseDelimitedWithIOException, parseUnknownField, parseUnknownFieldProto3, parseWithIOException, parseWithIOException, parseWithIOException, parseWithIOException, serializeBooleanMapTo, serializeIntegerMapTo, serializeLongMapTo, serializeStringMapTo, writeReplace, writeString, writeStringNoTag
-
Methods inherited from class com.google.protobuf.AbstractMessage
findInitializationErrors, getInitializationErrorString, hashBoolean, hashEnum, hashEnumList, hashFields, hashLong, toString
-
Methods inherited from class com.google.protobuf.AbstractMessageLite
addAll, addAll, checkByteStringIsUtf8, toByteArray, toByteString, writeDelimitedTo, writeTo
-
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
-
-
-
-
Field Detail
-
FRACTION_SPLIT_FIELD_NUMBER
public static final int FRACTION_SPLIT_FIELD_NUMBER
- See Also:
- Constant Field Values
-
FILTER_SPLIT_FIELD_NUMBER
public static final int FILTER_SPLIT_FIELD_NUMBER
- See Also:
- Constant Field Values
-
PREDEFINED_SPLIT_FIELD_NUMBER
public static final int PREDEFINED_SPLIT_FIELD_NUMBER
- See Also:
- Constant Field Values
-
TIMESTAMP_SPLIT_FIELD_NUMBER
public static final int TIMESTAMP_SPLIT_FIELD_NUMBER
- See Also:
- Constant Field Values
-
STRATIFIED_SPLIT_FIELD_NUMBER
public static final int STRATIFIED_SPLIT_FIELD_NUMBER
- See Also:
- Constant Field Values
-
GCS_DESTINATION_FIELD_NUMBER
public static final int GCS_DESTINATION_FIELD_NUMBER
- See Also:
- Constant Field Values
-
BIGQUERY_DESTINATION_FIELD_NUMBER
public static final int BIGQUERY_DESTINATION_FIELD_NUMBER
- See Also:
- Constant Field Values
-
DATASET_ID_FIELD_NUMBER
public static final int DATASET_ID_FIELD_NUMBER
- See Also:
- Constant Field Values
-
ANNOTATIONS_FILTER_FIELD_NUMBER
public static final int ANNOTATIONS_FILTER_FIELD_NUMBER
- See Also:
- Constant Field Values
-
ANNOTATION_SCHEMA_URI_FIELD_NUMBER
public static final int ANNOTATION_SCHEMA_URI_FIELD_NUMBER
- See Also:
- Constant Field Values
-
SAVED_QUERY_ID_FIELD_NUMBER
public static final int SAVED_QUERY_ID_FIELD_NUMBER
- See Also:
- Constant Field Values
-
PERSIST_ML_USE_ASSIGNMENT_FIELD_NUMBER
public static final int PERSIST_ML_USE_ASSIGNMENT_FIELD_NUMBER
- See Also:
- Constant Field Values
-
-
Method Detail
-
newInstance
protected Object newInstance(com.google.protobuf.GeneratedMessageV3.UnusedPrivateParameter unused)
- Overrides:
newInstancein classcom.google.protobuf.GeneratedMessageV3
-
getDescriptor
public static final com.google.protobuf.Descriptors.Descriptor getDescriptor()
-
internalGetFieldAccessorTable
protected com.google.protobuf.GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()
- Specified by:
internalGetFieldAccessorTablein classcom.google.protobuf.GeneratedMessageV3
-
getSplitCase
public InputDataConfig.SplitCase getSplitCase()
- Specified by:
getSplitCasein interfaceInputDataConfigOrBuilder
-
getDestinationCase
public InputDataConfig.DestinationCase getDestinationCase()
- Specified by:
getDestinationCasein interfaceInputDataConfigOrBuilder
-
hasFractionSplit
public boolean hasFractionSplit()
Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1beta1.FractionSplit fraction_split = 2;- Specified by:
hasFractionSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the fractionSplit field is set.
-
getFractionSplit
public FractionSplit getFractionSplit()
Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1beta1.FractionSplit fraction_split = 2;- Specified by:
getFractionSplitin interfaceInputDataConfigOrBuilder- Returns:
- The fractionSplit.
-
getFractionSplitOrBuilder
public FractionSplitOrBuilder getFractionSplitOrBuilder()
Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1beta1.FractionSplit fraction_split = 2;- Specified by:
getFractionSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasFilterSplit
public boolean hasFilterSplit()
Split based on the provided filters for each set.
.google.cloud.aiplatform.v1beta1.FilterSplit filter_split = 3;- Specified by:
hasFilterSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the filterSplit field is set.
-
getFilterSplit
public FilterSplit getFilterSplit()
Split based on the provided filters for each set.
.google.cloud.aiplatform.v1beta1.FilterSplit filter_split = 3;- Specified by:
getFilterSplitin interfaceInputDataConfigOrBuilder- Returns:
- The filterSplit.
-
getFilterSplitOrBuilder
public FilterSplitOrBuilder getFilterSplitOrBuilder()
Split based on the provided filters for each set.
.google.cloud.aiplatform.v1beta1.FilterSplit filter_split = 3;- Specified by:
getFilterSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasPredefinedSplit
public boolean hasPredefinedSplit()
Supported only for tabular Datasets. Split based on a predefined key.
.google.cloud.aiplatform.v1beta1.PredefinedSplit predefined_split = 4;- Specified by:
hasPredefinedSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the predefinedSplit field is set.
-
getPredefinedSplit
public PredefinedSplit getPredefinedSplit()
Supported only for tabular Datasets. Split based on a predefined key.
.google.cloud.aiplatform.v1beta1.PredefinedSplit predefined_split = 4;- Specified by:
getPredefinedSplitin interfaceInputDataConfigOrBuilder- Returns:
- The predefinedSplit.
-
getPredefinedSplitOrBuilder
public PredefinedSplitOrBuilder getPredefinedSplitOrBuilder()
Supported only for tabular Datasets. Split based on a predefined key.
.google.cloud.aiplatform.v1beta1.PredefinedSplit predefined_split = 4;- Specified by:
getPredefinedSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasTimestampSplit
public boolean hasTimestampSplit()
Supported only for tabular Datasets. Split based on the timestamp of the input data pieces.
.google.cloud.aiplatform.v1beta1.TimestampSplit timestamp_split = 5;- Specified by:
hasTimestampSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the timestampSplit field is set.
-
getTimestampSplit
public TimestampSplit getTimestampSplit()
Supported only for tabular Datasets. Split based on the timestamp of the input data pieces.
.google.cloud.aiplatform.v1beta1.TimestampSplit timestamp_split = 5;- Specified by:
getTimestampSplitin interfaceInputDataConfigOrBuilder- Returns:
- The timestampSplit.
-
getTimestampSplitOrBuilder
public TimestampSplitOrBuilder getTimestampSplitOrBuilder()
Supported only for tabular Datasets. Split based on the timestamp of the input data pieces.
.google.cloud.aiplatform.v1beta1.TimestampSplit timestamp_split = 5;- Specified by:
getTimestampSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasStratifiedSplit
public boolean hasStratifiedSplit()
Supported only for tabular Datasets. Split based on the distribution of the specified column.
.google.cloud.aiplatform.v1beta1.StratifiedSplit stratified_split = 12;- Specified by:
hasStratifiedSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the stratifiedSplit field is set.
-
getStratifiedSplit
public StratifiedSplit getStratifiedSplit()
Supported only for tabular Datasets. Split based on the distribution of the specified column.
.google.cloud.aiplatform.v1beta1.StratifiedSplit stratified_split = 12;- Specified by:
getStratifiedSplitin interfaceInputDataConfigOrBuilder- Returns:
- The stratifiedSplit.
-
getStratifiedSplitOrBuilder
public StratifiedSplitOrBuilder getStratifiedSplitOrBuilder()
Supported only for tabular Datasets. Split based on the distribution of the specified column.
.google.cloud.aiplatform.v1beta1.StratifiedSplit stratified_split = 12;- Specified by:
getStratifiedSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasGcsDestination
public boolean hasGcsDestination()
The Cloud Storage location where the training data is to be written to. In the given directory a new directory is created with name: `dataset-<dataset-id>-<annotation-type>-<timestamp-of-training-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All training input data is written into that directory. The Vertex AI environment variables representing Cloud Storage data URIs are represented in the Cloud Storage wildcard format to support sharded data. e.g.: "gs://.../training-*.jsonl" * AIP_DATA_FORMAT = "jsonl" for non-tabular data, "csv" for tabular data * AIP_TRAINING_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/training-*.${AIP_DATA_FORMAT}" * AIP_VALIDATION_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/validation-*.${AIP_DATA_FORMAT}" * AIP_TEST_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/test-*.${AIP_DATA_FORMAT}".google.cloud.aiplatform.v1beta1.GcsDestination gcs_destination = 8;- Specified by:
hasGcsDestinationin interfaceInputDataConfigOrBuilder- Returns:
- Whether the gcsDestination field is set.
-
getGcsDestination
public GcsDestination getGcsDestination()
The Cloud Storage location where the training data is to be written to. In the given directory a new directory is created with name: `dataset-<dataset-id>-<annotation-type>-<timestamp-of-training-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All training input data is written into that directory. The Vertex AI environment variables representing Cloud Storage data URIs are represented in the Cloud Storage wildcard format to support sharded data. e.g.: "gs://.../training-*.jsonl" * AIP_DATA_FORMAT = "jsonl" for non-tabular data, "csv" for tabular data * AIP_TRAINING_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/training-*.${AIP_DATA_FORMAT}" * AIP_VALIDATION_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/validation-*.${AIP_DATA_FORMAT}" * AIP_TEST_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/test-*.${AIP_DATA_FORMAT}".google.cloud.aiplatform.v1beta1.GcsDestination gcs_destination = 8;- Specified by:
getGcsDestinationin interfaceInputDataConfigOrBuilder- Returns:
- The gcsDestination.
-
getGcsDestinationOrBuilder
public GcsDestinationOrBuilder getGcsDestinationOrBuilder()
The Cloud Storage location where the training data is to be written to. In the given directory a new directory is created with name: `dataset-<dataset-id>-<annotation-type>-<timestamp-of-training-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All training input data is written into that directory. The Vertex AI environment variables representing Cloud Storage data URIs are represented in the Cloud Storage wildcard format to support sharded data. e.g.: "gs://.../training-*.jsonl" * AIP_DATA_FORMAT = "jsonl" for non-tabular data, "csv" for tabular data * AIP_TRAINING_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/training-*.${AIP_DATA_FORMAT}" * AIP_VALIDATION_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/validation-*.${AIP_DATA_FORMAT}" * AIP_TEST_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/test-*.${AIP_DATA_FORMAT}".google.cloud.aiplatform.v1beta1.GcsDestination gcs_destination = 8;- Specified by:
getGcsDestinationOrBuilderin interfaceInputDataConfigOrBuilder
-
hasBigqueryDestination
public boolean hasBigqueryDestination()
Only applicable to custom training with tabular Dataset with BigQuery source. The BigQuery project location where the training data is to be written to. In the given project a new dataset is created with name `dataset_<dataset-id>_<annotation-type>_<timestamp-of-training-call>` where timestamp is in YYYY_MM_DDThh_mm_ss_sssZ format. All training input data is written into that dataset. In the dataset three tables are created, `training`, `validation` and `test`. * AIP_DATA_FORMAT = "bigquery". * AIP_TRAINING_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.training" * AIP_VALIDATION_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.validation" * AIP_TEST_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.test"
.google.cloud.aiplatform.v1beta1.BigQueryDestination bigquery_destination = 10;- Specified by:
hasBigqueryDestinationin interfaceInputDataConfigOrBuilder- Returns:
- Whether the bigqueryDestination field is set.
-
getBigqueryDestination
public BigQueryDestination getBigqueryDestination()
Only applicable to custom training with tabular Dataset with BigQuery source. The BigQuery project location where the training data is to be written to. In the given project a new dataset is created with name `dataset_<dataset-id>_<annotation-type>_<timestamp-of-training-call>` where timestamp is in YYYY_MM_DDThh_mm_ss_sssZ format. All training input data is written into that dataset. In the dataset three tables are created, `training`, `validation` and `test`. * AIP_DATA_FORMAT = "bigquery". * AIP_TRAINING_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.training" * AIP_VALIDATION_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.validation" * AIP_TEST_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.test"
.google.cloud.aiplatform.v1beta1.BigQueryDestination bigquery_destination = 10;- Specified by:
getBigqueryDestinationin interfaceInputDataConfigOrBuilder- Returns:
- The bigqueryDestination.
-
getBigqueryDestinationOrBuilder
public BigQueryDestinationOrBuilder getBigqueryDestinationOrBuilder()
Only applicable to custom training with tabular Dataset with BigQuery source. The BigQuery project location where the training data is to be written to. In the given project a new dataset is created with name `dataset_<dataset-id>_<annotation-type>_<timestamp-of-training-call>` where timestamp is in YYYY_MM_DDThh_mm_ss_sssZ format. All training input data is written into that dataset. In the dataset three tables are created, `training`, `validation` and `test`. * AIP_DATA_FORMAT = "bigquery". * AIP_TRAINING_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.training" * AIP_VALIDATION_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.validation" * AIP_TEST_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.test"
.google.cloud.aiplatform.v1beta1.BigQueryDestination bigquery_destination = 10;- Specified by:
getBigqueryDestinationOrBuilderin interfaceInputDataConfigOrBuilder
-
getDatasetId
public String getDatasetId()
Required. The ID of the Dataset in the same Project and Location which data will be used to train the Model. The Dataset must use schema compatible with Model being trained, and what is compatible should be described in the used TrainingPipeline's [training_task_definition] [google.cloud.aiplatform.v1beta1.TrainingPipeline.training_task_definition]. For tabular Datasets, all their data is exported to training, to pick and choose from.
string dataset_id = 1 [(.google.api.field_behavior) = REQUIRED];- Specified by:
getDatasetIdin interfaceInputDataConfigOrBuilder- Returns:
- The datasetId.
-
getDatasetIdBytes
public com.google.protobuf.ByteString getDatasetIdBytes()
Required. The ID of the Dataset in the same Project and Location which data will be used to train the Model. The Dataset must use schema compatible with Model being trained, and what is compatible should be described in the used TrainingPipeline's [training_task_definition] [google.cloud.aiplatform.v1beta1.TrainingPipeline.training_task_definition]. For tabular Datasets, all their data is exported to training, to pick and choose from.
string dataset_id = 1 [(.google.api.field_behavior) = REQUIRED];- Specified by:
getDatasetIdBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for datasetId.
-
getAnnotationsFilter
public String getAnnotationsFilter()
Applicable only to Datasets that have DataItems and Annotations. A filter on Annotations of the Dataset. Only Annotations that both match this filter and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on (for the auto-assigned that role is decided by Vertex AI). A filter with same syntax as the one used in [ListAnnotations][google.cloud.aiplatform.v1beta1.DatasetService.ListAnnotations] may be used, but note here it filters across all Annotations of the Dataset, and not just within a single DataItem.
string annotations_filter = 6;- Specified by:
getAnnotationsFilterin interfaceInputDataConfigOrBuilder- Returns:
- The annotationsFilter.
-
getAnnotationsFilterBytes
public com.google.protobuf.ByteString getAnnotationsFilterBytes()
Applicable only to Datasets that have DataItems and Annotations. A filter on Annotations of the Dataset. Only Annotations that both match this filter and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on (for the auto-assigned that role is decided by Vertex AI). A filter with same syntax as the one used in [ListAnnotations][google.cloud.aiplatform.v1beta1.DatasetService.ListAnnotations] may be used, but note here it filters across all Annotations of the Dataset, and not just within a single DataItem.
string annotations_filter = 6;- Specified by:
getAnnotationsFilterBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for annotationsFilter.
-
getAnnotationSchemaUri
public String getAnnotationSchemaUri()
Applicable only to custom training with Datasets that have DataItems and Annotations. Cloud Storage URI that points to a YAML file describing the annotation schema. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). The schema files that can be used here are found in gs://google-cloud-aiplatform/schema/dataset/annotation/ , note that the chosen schema must be consistent with [metadata][google.cloud.aiplatform.v1beta1.Dataset.metadata_schema_uri] of the Dataset specified by [dataset_id][google.cloud.aiplatform.v1beta1.InputDataConfig.dataset_id]. Only Annotations that both match this schema and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter] and [annotation_schema_uri][google.cloud.aiplatform.v1beta1.InputDataConfig.annotation_schema_uri].
string annotation_schema_uri = 9;- Specified by:
getAnnotationSchemaUriin interfaceInputDataConfigOrBuilder- Returns:
- The annotationSchemaUri.
-
getAnnotationSchemaUriBytes
public com.google.protobuf.ByteString getAnnotationSchemaUriBytes()
Applicable only to custom training with Datasets that have DataItems and Annotations. Cloud Storage URI that points to a YAML file describing the annotation schema. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). The schema files that can be used here are found in gs://google-cloud-aiplatform/schema/dataset/annotation/ , note that the chosen schema must be consistent with [metadata][google.cloud.aiplatform.v1beta1.Dataset.metadata_schema_uri] of the Dataset specified by [dataset_id][google.cloud.aiplatform.v1beta1.InputDataConfig.dataset_id]. Only Annotations that both match this schema and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter] and [annotation_schema_uri][google.cloud.aiplatform.v1beta1.InputDataConfig.annotation_schema_uri].
string annotation_schema_uri = 9;- Specified by:
getAnnotationSchemaUriBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for annotationSchemaUri.
-
getSavedQueryId
public String getSavedQueryId()
Only applicable to Datasets that have SavedQueries. The ID of a SavedQuery (annotation set) under the Dataset specified by [dataset_id][google.cloud.aiplatform.v1beta1.InputDataConfig.dataset_id] used for filtering Annotations for training. Only Annotations that are associated with this SavedQuery are used in respectively training. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [saved_query_id][google.cloud.aiplatform.v1beta1.InputDataConfig.saved_query_id] and [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter]. Only one of [saved_query_id][google.cloud.aiplatform.v1beta1.InputDataConfig.saved_query_id] and [annotation_schema_uri][google.cloud.aiplatform.v1beta1.InputDataConfig.annotation_schema_uri] should be specified as both of them represent the same thing: problem type.
string saved_query_id = 7;- Specified by:
getSavedQueryIdin interfaceInputDataConfigOrBuilder- Returns:
- The savedQueryId.
-
getSavedQueryIdBytes
public com.google.protobuf.ByteString getSavedQueryIdBytes()
Only applicable to Datasets that have SavedQueries. The ID of a SavedQuery (annotation set) under the Dataset specified by [dataset_id][google.cloud.aiplatform.v1beta1.InputDataConfig.dataset_id] used for filtering Annotations for training. Only Annotations that are associated with this SavedQuery are used in respectively training. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [saved_query_id][google.cloud.aiplatform.v1beta1.InputDataConfig.saved_query_id] and [annotations_filter][google.cloud.aiplatform.v1beta1.InputDataConfig.annotations_filter]. Only one of [saved_query_id][google.cloud.aiplatform.v1beta1.InputDataConfig.saved_query_id] and [annotation_schema_uri][google.cloud.aiplatform.v1beta1.InputDataConfig.annotation_schema_uri] should be specified as both of them represent the same thing: problem type.
string saved_query_id = 7;- Specified by:
getSavedQueryIdBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for savedQueryId.
-
getPersistMlUseAssignment
public boolean getPersistMlUseAssignment()
Whether to persist the ML use assignment to data item system labels.
bool persist_ml_use_assignment = 11;- Specified by:
getPersistMlUseAssignmentin interfaceInputDataConfigOrBuilder- Returns:
- The persistMlUseAssignment.
-
isInitialized
public final boolean isInitialized()
- Specified by:
isInitializedin interfacecom.google.protobuf.MessageLiteOrBuilder- Overrides:
isInitializedin classcom.google.protobuf.GeneratedMessageV3
-
writeTo
public void writeTo(com.google.protobuf.CodedOutputStream output) throws IOException- Specified by:
writeToin interfacecom.google.protobuf.MessageLite- Overrides:
writeToin classcom.google.protobuf.GeneratedMessageV3- Throws:
IOException
-
getSerializedSize
public int getSerializedSize()
- Specified by:
getSerializedSizein interfacecom.google.protobuf.MessageLite- Overrides:
getSerializedSizein classcom.google.protobuf.GeneratedMessageV3
-
equals
public boolean equals(Object obj)
- Specified by:
equalsin interfacecom.google.protobuf.Message- Overrides:
equalsin classcom.google.protobuf.AbstractMessage
-
hashCode
public int hashCode()
- Specified by:
hashCodein interfacecom.google.protobuf.Message- Overrides:
hashCodein classcom.google.protobuf.AbstractMessage
-
parseFrom
public static InputDataConfig parseFrom(ByteBuffer data) throws com.google.protobuf.InvalidProtocolBufferException
- Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException
- Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.ByteString data) throws com.google.protobuf.InvalidProtocolBufferException
- Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException
- Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(byte[] data) throws com.google.protobuf.InvalidProtocolBufferException
- Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException
- Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(InputStream input) throws IOException
- Throws:
IOException
-
parseFrom
public static InputDataConfig parseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException
- Throws:
IOException
-
parseDelimitedFrom
public static InputDataConfig parseDelimitedFrom(InputStream input) throws IOException
- Throws:
IOException
-
parseDelimitedFrom
public static InputDataConfig parseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException
- Throws:
IOException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.CodedInputStream input) throws IOException
- Throws:
IOException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException
- Throws:
IOException
-
newBuilderForType
public InputDataConfig.Builder newBuilderForType()
- Specified by:
newBuilderForTypein interfacecom.google.protobuf.Message- Specified by:
newBuilderForTypein interfacecom.google.protobuf.MessageLite
-
newBuilder
public static InputDataConfig.Builder newBuilder()
-
newBuilder
public static InputDataConfig.Builder newBuilder(InputDataConfig prototype)
-
toBuilder
public InputDataConfig.Builder toBuilder()
- Specified by:
toBuilderin interfacecom.google.protobuf.Message- Specified by:
toBuilderin interfacecom.google.protobuf.MessageLite
-
newBuilderForType
protected InputDataConfig.Builder newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent)
- Specified by:
newBuilderForTypein classcom.google.protobuf.GeneratedMessageV3
-
getDefaultInstance
public static InputDataConfig getDefaultInstance()
-
parser
public static com.google.protobuf.Parser<InputDataConfig> parser()
-
getParserForType
public com.google.protobuf.Parser<InputDataConfig> getParserForType()
- Specified by:
getParserForTypein interfacecom.google.protobuf.Message- Specified by:
getParserForTypein interfacecom.google.protobuf.MessageLite- Overrides:
getParserForTypein classcom.google.protobuf.GeneratedMessageV3
-
getDefaultInstanceForType
public InputDataConfig getDefaultInstanceForType()
- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageLiteOrBuilder- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageOrBuilder
-
-