92 lines
11 KiB
Plaintext
92 lines
11 KiB
Plaintext
|
Ë
|
|||
|
|
=û g»% ã óL — d dl Z d dlmZ d dlmZmZmZmZmZ d dl Z d dl
|
|||
|
|
m Z d dl m
|
|||
|
|
Z
|
|||
|
|
ddlmZmZ ddlmZ dd lmZ dd
|
|||
|
|
lmZ d d lmZmZmZmZm Z m Z ej< d
|
|||
|
|
« ej< d« edd¬« eddd¬« eddddd¬« edddd ¬« ed d d d ¬« edd!d"d#¬« edd$d%d&dd¬'« ed(d)d*d+¬« edd,d-d.¬« ed/d0d1d2¬« f
|
|||
|
|
d3e d4ed5ee d6ee d7e d8e!d9ee d:e d;e!d<e fd=„« « Z" dRd3e d4ed5ee d7e d8e!d9ee d:e d>e!d<e d;e!d?ee ef fd@„Z#i fd/ddAœdBee ef dCee ef d<e d>e!d?ee ef f
|
|||
|
|
dD„Z$ dSdEee dFedGe dHe dIe!dJe!dKe!fdL„Z%dMe
|
|||
|
|
dBee ee e&f f dNe dOe d?df
|
|||
|
|
dP„Z'dMe
|
|||
|
|
dBee ee e&f f d?dfdQ„Z(y)Té N)ÚPath)ÚAnyÚDictÚListÚOptionalÚUnion)Úfix_random_seed)ÚPrinteré )ÚdisplacyÚutil)ÚScorer)ÚDoc)ÚCorpusé )ÚArgÚOptÚappÚ
|
|||
|
|
benchmark_cliÚ import_codeÚ setup_gpuÚaccuracyÚevaluate.zModel name or path)Úhelpz3Location of binary evaluation data in .spacy formatT)r Úexistsz--outputz-oz Output JSON file for metricsF)r Údir_okayz--codez-czNPath to Python file with additional code (registered functions) to be importedéÿÿÿÿz--gpu-idz-gzGPU ID or -1 for CPUz--gold-preprocz-GzUse gold preprocessingz--displacy-pathz-dpz+Directory to output rendered parses as HTML)r r Ú file_okayé z--displacy-limitz-dlz!Limit of parses to render as HTMLz--per-componentz-PzSReturn scores per component, only applicable when an output JSON file is specified.Úscz --spans-keyz-skz*Spans key to use when evaluating Doc.spansÚmodelÚ data_pathÚoutputÚ code_pathÚuse_gpuÚ gold_preprocÚ
|
|||
|
|
displacy_pathÚdisplacy_limitÚ
|
|||
|
|
per_componentÚ spans_keyc
|
|||
|
|
óD — t |« t | |||||||d| ¬«
|
|||
|
|
y)am
|
|||
|
|
Evaluate a trained pipeline. Expects a loadable spaCy pipeline and evaluation
|
|||
|
|
data in the binary .spacy format. The --gold-preproc option sets up the
|
|||
|
|
evaluation examples with gold-standard sentences and tokens for the
|
|||
|
|
predictions. Gold preprocessing helps the annotations align to the
|
|||
|
|
tokenization, and may result in sequences of more consistent length. However,
|
|||
|
|
it may reduce runtime accuracy due to train/test skew. To render a sample of
|
|||
|
|
dependency parses in a HTML file, set as output directory as the
|
|||
|
|
displacy_path argument.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/cli#benchmark-accuracy
|
|||
|
|
F)r# r% r& r' r( r) Úsilentr* N)r r )
|
|||
|
|
r! r" r# r$ r% r& r' r( r) r* s
|
|||
|
|
úSC:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/cli/evaluate.pyÚ evaluate_clir. s2 € ô< � ÔÜ Ø
|
|||
|
|
ØØØØ!Ø#Ø%Ø#ØØö ó r, Úreturnc
|
|||
|
|
óÞ — t || ¬« }
|
|||
|
|
t « t ||¬« t j |« }t j |« } t j |« }|j « s|
|
|||
|
|
j
|
|||
|
|
d|d¬« |r$|j « s|
|
|||
|
|
j
|
|||
|
|
d|d¬« t ||¬« } t j | « }
|
|||
|
|
t | |
|
|||
|
|
« « }|
|
|||
|
|
j || ¬« }| r*|}|€|
|
|||
|
|
j d « �n"|
|
|||
|
|
j d
|
|||
|
|
« �ni d d “d
|
|||
|
|
d“dd“dd“dd“dd“dd“dd“dd “d d “d d “d!d"“d#d$“d%d&“d'd(|› d)�“d*d(|› d+�“d,d(|› d-�“d.d/i¥}i }i }|j « D ]‘ \ }}||v sŒ |d k( r|d0z |j d1d2« z d3z }t || t t" f« r |d/k( r || d4›||< n|| d5z d6›||< nd7||< || |t% j& d8d9|j) « « < Œ“ |
|
|||
|
|
j+ |d:¬;« t- ||||¬<« }|rŠ|
|
|||
|
|
j. D �cg c] }|
|
|||
|
|
j1 |« j2 ‘Œ }}t |
|
|||
|
|
j5 d=„ |d | D « « « }d>|v }d?|v }d@|v }t7 ||| ||||¬A« |
|
|||
|
|
j9 dB|› dC�|« | �*t; j< | |« |
|
|||
|
|
j9 dD| › �« |S c c}w )EN©Úno_printÚpretty)r, zEvaluation data not foundr )Úexitsz(Visualization output directory not found)r& )r) zdThe per-component option is enabled but there is no output JSON file provided to save the scores to.z7Per-component scores will be saved to output JSON file.ÚTOKÚ token_accÚTAGÚtag_accÚPOSÚpos_accÚMORPHÚ morph_accÚLEMMAÚ lemma_accÚUASÚdep_uasÚLASÚdep_laszNER PÚents_pzNER RÚents_rzNER FÚents_fÚTEXTCATÚ
|
|||
|
|
cats_scorezSENT PÚsents_pzSENT RÚsents_rzSENT FÚsents_fzSPAN PÚspans_Ú_pzSPAN RÚ_rzSPAN FÚ_fÚSPEEDÚspeedz (Úcats_score_descÚunkú)z.0féd ú.2fú-z[\s/]Ú_ÚResults)Útitle©r* r, c 3 óH K — | ] }|j j –— Œ y w)N)Ú referenceÚtext)Ú.0Úexs r- ú <genexpr>zevaluate.<locals>.<genexpr>ˆ s è ø€ Ð VÑ9U°2˜RŸ\™\× .Õ .Ñ9Uùs ‚ "ÚparserÚnerÚspancat)Ú
|
|||
|
|
model_nameÚlimitÚdepsÚentsÚspansz
|
|||
|
|
Generated z parses as HTMLzSaved results to ) r
|
|||
|
|
r r r
|
|||
|
|
Ú ensure_pathr Úfailr Ú
|
|||
|
|
load_modelÚlistr ÚwarnÚinfoÚitemsÚgetÚ
|
|||
|
|
isinstanceÚintÚfloatÚreÚsubÚlowerÚtableÚhandle_scores_per_typeÚ
|
|||
|
|
pipe_namesÚ
|
|||
|
|
get_pipe_metaÚfactoryÚpipeÚ
|
|||
|
|
render_parsesÚgoodÚsrslyÚ
|
|||
|
|
write_json)r! r" r# r% r& r' r( r, r* r) ÚmsgÚ output_pathÚcorpusÚnlpÚ dev_datasetÚscoresÚdataÚmetricsÚresultsÚmetricÚkeyr} Ú
|
|||
|
|
factory_namesÚdocsÚ render_depsÚ render_entsÚ render_spanss r- r r = s¡ € ô ˜6¨f¨*Ô
|
|||
|
|
5€CÜÔÜ
|
|||
|
|
ˆg˜fÕ%Ü× Ñ Ó+€IÜ×"Ñ" 6Ó*€KÜ×$Ñ$ ]Ó3€MØ × Ñ Ô Ø �‰Ð,¨i¸qˆÔAÙ˜]× 1Ñ 1Ô 3Ø �‰Ð;¸]ÐRSˆÔTÜ
|
|||
|
|
�I¨LÔ
|
|||
|
|
9€FÜ
|
|||
|
|
�/‰/˜%Ó
|
|||
|
|
€CÜ‘v˜c“{Ó#€KØ
|
|||
|
|
�\‰\˜+°]ˆ\Ó
|
|||
|
|
C€FÙØˆØ ˆ>Ø �H‰HØvö
|
|||
|
|
ð
|
|||
|
|
�H‰HÐNÖ Oð
|
|||
|
|
Ø �;ð
|
|||
|
|
à �9ð
|
|||
|
|
ð
|
|||
|
|
�9ð
|
|||
|
|
ð
|
|||
|
|
�[ð
|
|||
|
|
ð
|
|||
|
|
|
|||
|
|
�[ð
|
|||
|
|
ð
|
|||
|
|
�9ð
|
|||
|
|
|
|||
|
|
ð
|
|||
|
|
�9ð
|
|||
|
|
ð
|
|||
|
|
�Xð
|
|||
|
|
ð
|
|||
|
|
�Xð
|
|||
|
|
ð
|
|||
|
|
�Xð
|