43 lines
7.6 KiB
Plaintext
43 lines
7.6 KiB
Plaintext
|
Ë
|
|||
|
|
=û g ã óž — d dl Z d dlmZ d dlmZ d dlZd dlZd dlmZ ddl m
|
|||
|
|
Z
|
|||
|
|
ddl m Z ddl
|
|||
|
|
mZmZ d d
|
|||
|
|
lmZmZmZmZmZmZmZ ej0 d « ed d
|
|||
|
|
¬« ed dd¬« ed d¬« edddd¬« ed ddd¬« eddd d ¬« edd d d ¬« ed!d"d#d$d%¬« edd&d'd(d¬)« ed*d+d,d-¬« f
|
|||
|
|
d.ed/ed0ed1ed2ed3ed4ee d5ed6ee d7efd8„« Z d9e d6ed:dfd;„Z ej0 d9ddd<œd¬=« ed d>dd¬?« ed d@¬« eddAdBdC¬« ed!d"d#d$d%¬« eddDdEdF¬« fdGej< dHedIedJee d5edKef dL„« Z ej0 dMddd<œ¬N« ed d>dd¬?« ed dO¬« eddAdBdC¬« ed!d"d#d$d%¬« eddDdEdF¬« fdGej< dHedIedJee d5edKef dP„« Z dQ„ Z!y)Ré N)ÚPath)ÚOptional)Úmsgé )Úutil)ÚLanguage)Úconvert_vectorsÚinit_nlpé )ÚArgÚOptÚ import_codeÚinit_cliÚparse_config_overridesÚ setup_gpuÚshow_validation_errorÚvectors.z(The language of the nlp object to create)Úhelpz Vectors file in Word2Vec formatT)r ÚexistszPipeline output directoryéÿÿÿÿz--prunez-pz&Optional number of vectors to prune toz
|
|||
|
|
--truncatez-tzFOptional number of vectors to truncate to when reading in vectors fileÚdefaultz--modez-mz Vectors mode: default or floretz--namez-nz?Optional name for the word vectors, e.g. en_core_web_lg.vectorsFz --verbosez-Vz-VVz/Display more information for debugging purposesz--lexemes-jsonlz-jz+Location of JSONL-formatted attributes file)r ÚhiddenÚORTHz--attrz-az?Optional token attribute to use for vectors, e.g. LOWER or NORMÚlangÚ vectors_locÚ
|
|||
|
|
output_dirÚpruneÚtruncateÚmodeÚnameÚverboseÚ jsonl_locÚattrc
|
|||
|
|
óÞ — |r-t j j t j « t j d| › d�« t j | « « }
|
|||
|
|
|� t |
|
|||
|
|
|« t |
|
|||
|
|
|||||| ¬« t j dt |
|
|||
|
|
j j « › d�« |
|
|||
|
|
j |« t j d|j « « y)zConvert word vectors for use with spaCy. Will export an nlp object that
|
|||
|
|
you can use in the [initialize] block of your config to initialize
|
|||
|
|
a model with vectors.
|
|||
|
|
z(Creating blank nlp object for language 'ú'N)r r r r r# zSuccessfully converted z vectorszŠSaved nlp object with vectors to output directory. You can now use the path to it in your config as the 'vectors' setting in [initialize].)r ÚloggerÚsetLevelÚloggingÚDEBUGr ÚinfoÚget_lang_classÚupdate_lexemesr ÚgoodÚlenÚvocabr Úto_diskÚresolve) r r r r r r r r! r" r# Únlps úXC:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/cli/init_pipeline.pyÚinit_vectors_clir4 sÇ € ñ& Ü � ‰ × Ñ œWŸ]™]Ô+܇H�HÐ7¸°v¸QÐ
|
|||
|
|
?Ô@Ø
|
|||
|
|
#Œ$×
|
|||
|
|
Ñ
|
|||
|
|
˜dÓ
|
|||
|
|
#Ó
|
|||
|
|
%€CØÐ Ü�s˜IÔ&ÜØ ØØØØ
|
|||
|
|
Ø
|
|||
|
|
Ø
|
|||
|
|
õô ‡H�HÐ&¤s¨3¯9©9×+<Ñ+<Ó'=Ð&>¸hÐ
|
|||
|
|
GÔH؇K�K�
|
|||
|
|
Ô܇H�Hð Nà×ÑÓ õó r2 Úreturnc óŽ — t j |« }|D ]+ }d|v rŒ| j |d } |j di |¤Ž Œ- y )NÚsettingsÚorth© )ÚsrslyÚ
|
|||
|
|
read_jsonlr/ Ú set_attrs)r2 r" Ú lex_attrsÚattrsÚlexemes r3 r, r, B sL € ä× Ñ Ó+€IÛˆØ ˜Ñ Ø Ø—‘˜5 ™=Ñ)ˆØˆ×ÑÑ!˜5Ó!ñ r5 )Úallow_extra_argsÚignore_unknown_options)Úcontext_settingsr zPath to config file)r r Ú
|
|||
|
|
allow_dashz&Output directory for the prepared dataz--codez-czNPath to Python file with additional code (registered functions) to be importedz--gpu-idz-gzGPU ID or -1 for CPUÚctxÚ config_pathÚ output_pathÚ code_pathÚuse_gpuc óÔ — |r-t j j t j « t | j « }t |« t |« t |« 5 t j ||¬« }d d d « t d¬« 5 t |¬« }d d d « j |« t j d|› �« y # 1 sw Y ŒUxY w# 1 sw Y Œ?xY w)N©Ú overridesF©Ú hint_fill©rI z Saved initialized pipeline to )r r& r' r( r) r Úargsr r r Ú load_configr
|
|||
|
|
r0 r r- © rE rF rG rH r! rI rL Úconfigr2 s r3 Úinit_pipeline_clirT L s£ € ñ Ü � ‰ × Ñ œWŸ]™]Ô+Ü& s§x¡xÓ0€IÜ� ÔÜ
|
|||
|
|
ˆgÔÜ ˜{Õ +Ü×!Ñ! +¸ÔCˆ÷
|
|||
|
|
,ä ¨Ö /Ü�v wÔ/ˆ÷
|
|||
|
|
0à‡K�K� Ô Ü‡H�HÐ-¨k¨]Ð
|
|||
|
|
;Õ<÷
|
|||
|
|
,Ð +úç /Ð /ús Á&CÂC ÃCÃ C'Úlabels)rC z Output directory for the labelsc óÞ — |r-t j j t j « |j « s|j
|
|||
|
|
d¬« t | j « }t |« t |« t |« 5 t j ||¬« }ddd« t d¬« 5 t |¬« }ddd« t |« y# 1 sw Y Œ8xY w# 1 sw Y Œ"xY w)z¦Generate JSON files for the labels in the data. This helps speed up the
|
|||
|
|
training process, since spaCy won't have to preprocess the data to
|
|||
|
|
extract the labels.T)ÚparentsrK NFrM rO )r r& r' r( r) r Úmkdirr rP r r r rQ r
|
|||
|
|
Ú _init_labelsrR s r3 Úinit_labels_clirZ h sª € ñ" Ü � ‰ × Ñ œWŸ]™]Ô+Ø × Ñ Ô Ø×Ñ $ÐÔ'Ü& s§x¡xÓ0€IÜ� ÔÜ
|
|||
|
|
ˆgÔÜ ˜{Õ +Ü×!Ñ! +¸ÔCˆ÷
|