file_instance
File representation models.
CheckSum
Bases: BaseModel
The 'checksum' object nested inside a DataFile.
Source code in src/dv_schema_models/file_instance.py
41 42 43 44 45 46 47 48 49 50 51 | |
get_raw(key)
Get a raw top-level field not covered by the schema (requires extra='allow').
Source code in src/dv_schema_models/file_instance.py
49 50 51 | |
DataFile
Bases: BaseModel
The 'dataFile' object nested inside a FileInstance.
Source code in src/dv_schema_models/file_instance.py
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | |
get_raw(key)
Get a raw top-level field not covered by the schema (requires extra='allow').
Source code in src/dv_schema_models/file_instance.py
36 37 38 | |
FileInstance
Bases: BaseModel
One file, as it appears inside a dataset version.
Source code in src/dv_schema_models/file_instance.py
54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 | |
get_raw(key)
Get a raw top-level field not covered by the schema (requires extra='allow').
Source code in src/dv_schema_models/file_instance.py
66 67 68 | |
list_field(instances, field)
staticmethod
Get the values of a field across instances, e.g. field="dataFile.checksum.type".
Skips instances where the path is missing or resolves to None.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
instances
|
list[FileInstance]
|
A list of FileInstance objects to extract values from. |
required |
field
|
str
|
The name of the field to extract, e.g. "dataFile.checksum.type". |
required |
Returns:
| Type | Description |
|---|---|
list[Any]
|
A list of values for the specified field across the instances. |
Source code in src/dv_schema_models/file_instance.py
96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 | |
sum_field(instances, field)
staticmethod
Sum a DataFile field across FileInstances, skipping entries with no dataFile or None values.
Returns None (and logs a warning) if any present value isn't int/float.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
instances
|
list[FileInstance]
|
A list of FileInstance objects to sum over. |
required |
field
|
str
|
The name of the field to sum, e.g. "dataFile.filesize". |
required |
Returns:
| Type | Description |
|---|---|
float | None
|
The sum of the field values, or None if any value is non-numeric. |
Source code in src/dv_schema_models/file_instance.py
70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 | |