unitorch.cli.models.xlm_roberta¤
XLMRobertaProcessor¤
Tip
core/process/xlm_roberta
is the section for configuration of XLMRobertaProcessor.
Bases: XLMRobertaProcessor
XLM-RoBERTa Processor for handling text processing tasks.
Initialize XLMRobertaProcessor.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
vocab_path |
str
|
The path to the vocabulary file. |
required |
max_seq_length |
int
|
The maximum sequence length. Defaults to 128. |
128
|
source_type_id |
int
|
The source type ID. Defaults to 0. |
0
|
target_type_id |
int
|
The target type ID. Defaults to 0. |
0
|
Source code in src/unitorch/cli/models/xlm_roberta/processing.py
25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
|
from_core_configure
classmethod
¤
from_core_configure(config, **kwargs)
Create an instance of XLMRobertaProcessor from a core configuration.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
config |
The core configuration. |
required | |
**kwargs |
Additional keyword arguments. |
{}
|
Returns:
Name | Type | Description |
---|---|---|
dict |
The processed arguments for initializing the processor. |
Source code in src/unitorch/cli/models/xlm_roberta/processing.py
48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 |
|
XLMRobertaForClassification¤
Tip
core/model/classification/xlm_roberta
is the section for configuration of XLMRobertaForClassification.
Bases: XLMRobertaForClassification
XLM-RoBERTa model for classification tasks.
Initialize XLMRobertaForClassification.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
config_path |
str
|
The path to the model configuration file. |
required |
num_classes |
int
|
The number of classes for classification. Defaults to 1. |
1
|
gradient_checkpointing |
bool
|
Whether to use gradient checkpointing. Defaults to False. |
False
|
Source code in src/unitorch/cli/models/xlm_roberta/modeling.py
26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 |
|
forward ¤
forward(
input_ids: Tensor,
attention_mask: Optional[Tensor] = None,
token_type_ids: Optional[Tensor] = None,
position_ids: Optional[Tensor] = None,
)
Perform a forward pass through the model.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
input_ids |
Tensor
|
Input token IDs. |
required |
attention_mask |
Tensor
|
Attention mask. Defaults to None. |
None
|
token_type_ids |
Tensor
|
Token type IDs. Defaults to None. |
None
|
position_ids |
Tensor
|
Position IDs. Defaults to None. |
None
|
Returns:
Name | Type | Description |
---|---|---|
ClassificationOutputs |
The classification outputs. |
Source code in src/unitorch/cli/models/xlm_roberta/modeling.py
84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 |
|
from_core_configure
classmethod
¤
from_core_configure(config, **kwargs)
Create an instance of XLMRobertaForClassification from a core configuration.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
config |
The core configuration. |
required | |
**kwargs |
Additional keyword arguments. |
{}
|
Returns:
Name | Type | Description |
---|---|---|
XLMRobertaForClassification |
The instantiated XLMRobertaForClassification model. |
Source code in src/unitorch/cli/models/xlm_roberta/modeling.py
46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 |
|
XLMRobertaXLForClassification¤
Tip
core/model/classification/xlm_roberta_xl
is the section for configuration of XLMRobertaXLForClassification.
Bases: XLMRobertaXLForClassification
XLM-RoBERTa XL model for classification tasks.
Initialize XLMRobertaXLForClassification.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
config_path |
str
|
The path to the model configuration file. |
required |
num_classes |
int
|
The number of classes for classification. Defaults to 1. |
1
|
gradient_checkpointing |
bool
|
Whether to use gradient checkpointing. Defaults to False. |
False
|
Source code in src/unitorch/cli/models/xlm_roberta/modeling.py
117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 |
|
forward ¤
forward(
input_ids: Tensor,
attention_mask: Optional[Tensor] = None,
token_type_ids: Optional[Tensor] = None,
position_ids: Optional[Tensor] = None,
)
Perform a forward pass through the model.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
input_ids |
Tensor
|
Input token IDs. |
required |
attention_mask |
Tensor
|
Attention mask. Defaults to None. |
None
|
token_type_ids |
Tensor
|
Token type IDs. Defaults to None. |
None
|
position_ids |
Tensor
|
Position IDs. Defaults to None. |
None
|
Returns:
Name | Type | Description |
---|---|---|
ClassificationOutputs |
The classification outputs. |
Source code in src/unitorch/cli/models/xlm_roberta/modeling.py
175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 |
|
from_core_configure
classmethod
¤
from_core_configure(config, **kwargs)
Create an instance of XLMRobertaXLForClassification from a core configuration.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
config |
The core configuration. |
required | |
**kwargs |
Additional keyword arguments. |
{}
|
Returns:
Name | Type | Description |
---|---|---|
XLMRobertaXLForClassification |
The instantiated XLMRobertaXLForClassification model. |
Source code in src/unitorch/cli/models/xlm_roberta/modeling.py
137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 |
|