flâneur

Fine-tuning (deep learning) - Wikipedia

en.wikipedia.org · 1,897 words · saved by 1 readers

In deep learning, fine-tuning is a process by which a model that was designed for one task (the upstream task) is specialized to a new task (the downstream task). As such, it is a special case of transfer learning. Fine-tuning involves applying additional training (e.g., on new data) to the parameters of a neural network that have been pre-trained.[1] Many variants exist. The additional training can be applied to the entire neural network, or to only a subset of its layers, in which case the layers that are not being fine-tuned are "frozen" (i.e., not changed during backpropagation).[2] A model may also be augmented with "adapters"—lightweight modules inserted into the model's architecture that nudge the embedding space for domain adaptation. These contain far fewer parameters than the original model and can be fine-tuned in a parameter-efficient way by tuning only their weights and leaving the rest of the model's weights frozen.[3] For some architectures, such as convolutional neural

Fine-tuning (deep learning) - Wikipedia Jump to content From Wikipedia, the free encyclopedia Machine learning technique In deep learning , fine-tuning is the process of adapting a computational model trained for one task (the upstream task ) to perform a different, usually more specific, task (the downstream task ). [ 1 ] It is considered a form of transfer learning , as it reuses knowledge learned from the original training objective. [ 2 ] [ 3 ] Fine-tuning involves applying additional training (e.g., on new data) to the parameters of a neural network that have been pre-trained. [ 4 ] [ 5 ]

related reading