76 lines
9.6 KiB
Plaintext
76 lines
9.6 KiB
Plaintext
|
Ë
|
|||
|
|
=û gó ã óH — d dl Z d dlZd dlmZ d dlmZ d dlmZmZm Z d dl
|
|||
|
|
Z
|
|||
|
|
d dl Z d dl m Z d dl
|
|||
|
|
mZ ddlmZ dd lmZ dd
|
|||
|
|
lmZ dd lmZ d d
|
|||
|
|
lmZmZmZmZm Z ej: ddddœ¬« edd¬« eddd¬« edddd d¬« edd d ¬« ed d d d!¬« ed"d#d$d%¬&« ed'd(d)d d*¬« edd+d,d-¬« fd.e j< d/e d0ed1e e d2e!d3e d4e d5e d6e e fd7„« Z" G d8„ d9« Z# G d:„ d;« Z$d<ed=ee d1e e d>e
|
|||
|
|
jJ fd?„Z&d<ed=ee d4e d1e d@e!d>e
|
|||
|
|
jJ f dA„Z'e
|
|||
|
|
jP dBfd>e
|
|||
|
|
jJ fdC„Z)d=ee d>e fdD„Z*dEe
|
|||
|
|
jJ fdF„Z+dEe
|
|||
|
|
jJ fdG„Z,d<ed=ee d5e d1e e d>e
|
|||
|
|
jJ f
|
|||
|
|
dH„Z-y)Ié N)Úislice)ÚPath)ÚIterableÚListÚOptional)Útqdm)Úmsgé )Úutil)ÚLanguage)ÚDoc)ÚCorpusé )ÚArgÚOptÚ
|
|||
|
|
benchmark_cliÚ import_codeÚ setup_gpuÚspeedT)Úallow_extra_argsÚignore_unknown_options)Úcontext_settings.zModel name or path)Úhelpz3Location of binary evaluation data in .spacy format)r Úexistsz --batch-sizez-bz Override the pipeline batch size)Úminr Fz --no-shufflez Do not shuffle benchmark dataéÿÿÿÿz--gpu-idz-gzGPU ID or -1 for CPUé2 z --batchesz&Minimum number of batches to benchmarké )r r é z--warmupz-wz-Number of iterations over the data for warmupz--codez-czNPath to Python file with additional code (registered functions) to be importedÚctxÚmodelÚ data_pathÚ
|
|||
|
|
batch_sizeÚ
|
|||
|
|
no_shuffleÚuse_gpuÚ n_batchesÚ
|
|||
|
|
warmup_epochsÚ code_pathc óò — t |« t |d¬« t j |« } |�|n | j }t |« }
|
|||
|
|
|
|
|||
|
|
| « D � cg c] } | j ‘Œ } } t | « dk( rt j dd¬« t d|› d �« t | | ||« t « t d
|
|||
|
|
|› d �« t | | ||| « }
|
|||
|
|
t « t |
|
|||
|
|
« t |
|
|||
|
|
« yc c} w ) zu
|
|||
|
|
Benchmark a pipeline. Expects a loadable spaCy pipeline and benchmark
|
|||
|
|
data in the binary .spacy format.
|
|||
|
|
F)r% ÚsilentNr z-Cannot benchmark speed using an empty corpus.r )ÚexitszWarming up for z
|
|||
|
|
epochs...z
|
|||
|
|
Benchmarking z batches...)r r r Ú
|
|||
|
|
load_modelr# r Ú predictedÚlenr ÚfailÚprintÚwarmupÚ benchmarkÚprint_outliersÚprint_mean_with_ci)r r! r" r# r$ r% r& r' r( ÚnlpÚcorpusÚegÚdocsÚwpss úZC:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/cli/benchmark_speed.pyÚbenchmark_speed_clir; s× € ô* � ÔÜ
|
|||
|
|
�g eÕ,ä
|
|||
|
|
�/‰/˜%Ó
|
|||
|
|
€CØ )Ð 5‘¸3¿>¹>€JÜ
|
|||
|
|
�IÓ
|
|||
|
|
€FÙ#)¨#¤;Ó /¡;˜RˆB�L‹L ;€DÐ /ä
|
|||
|
|
ˆ4ƒy�A‚~Ü �‰Ð@ÈÕJä ˆO˜M˜?¨*Ð
|
|||
|
|
5Ô6Ü
|
|||
|
|
ˆ3��m ZÔ0ä „GÜ ˆM˜)˜ KÐ
|
|||
|
|
0Ô1Ü
|
|||
|
|
�C˜˜y¨*¸*°nÓ
|
|||
|
|
E€Cä „GÜ�3ÔÜ�sÕùò 0s ÁC4c ó — e Zd ZdZd„ Zd„ Zy)Ú time_contextz'Register the running time of a context.c ó8 — t j « | _ | S ©N)ÚtimeÚ perf_counterÚstart)Úselfs r: Ú __enter__ztime_context.__enter__C s € Ü×&Ñ&Ó(ˆŒ
|
|||
|
|
؈ ó c óP — t j « | j z
|
|||
|
|
| _ y r? )r@ rA rB Úelapsed)rC ÚtypeÚvalueÚ tracebacks r: Ú__exit__ztime_context.__exit__G s € Ü×(Ñ(Ó*¨T¯Z©ZÑ7ˆ� rE N)Ú__name__Ú
|
|||
|
|
__module__Ú __qualname__Ú__doc__rD rK © rE r: r= r= @ s „ Ù1òó8rE r= c ó^ — e Zd ZU dZeed< eed< eed< eed< dej ddfd „Zy)
|
|||
|
|
Ú QuartileszVCalculate the q1, q2, q3 quartiles and the inter-quartile range (iqr)
|
|||
|
|
of a sample.Úq1Úq2Úq3ÚiqrÚsampleÚreturnNc óâ — t j |d« | _ t j |d« | _ t j |d« | _ | j | j z
|
|||
|
|
| _ y )Ng Ð?g à?g è?)ÚnumpyÚquantilerS rT rU rV )rC rW s r: Ú__init__zQuartiles.__init__T sL € Ü—.‘. ¨Ó.ˆŒÜ—.‘. ¨Ó-ˆŒÜ—.‘. ¨Ó.ˆŒØ—7‘7˜TŸW™WÑ$ˆ�rE ) rL rM rN rO ÚfloatÚ__annotations__rZ Úndarrayr\ rP rE r: rR rR K s4 … ñð ƒIØ
|
|||
|
|
ƒIØ
|
|||
|
|
ƒIØ ƒJð%˜uŸ}™}ð %°ô %rE rR r5 r8 rX c óf — | j t |dd ¬« |¬« }g } t « 5 }t t ||r|n | j
|
|||
|
|
« « }d d d « t
|
|||
|
|
« dk( rn*t |« }|j |j z « Œot j |« S # 1 sw Y ŒWxY w)NÚdoc)ÚunitÚdisable)r# r ) Úpiper r= Úlistr r# r. Ú count_tokensÚappendrG rZ Úarray)r5 r8 r# r9 rG Ú
|
|||
|
|
batch_docsÚn_tokenss r: Úannotaterk [ s� € ð �8‰8”D˜ E°4Ô8ÀZˆ8Ó P€DØ
|
|||
|
|
€CØ
|
|||
|
|
Ü
|
|||
|
|
Œ^˜wÜ Ü�t©:™Z¸3¿>¹>ÓJóˆJ÷ ô ˆz‹?˜aÒ Ø Ü
|
|||
|
|
Ó+ˆØ �
|
|||
|
|
‰
|
|||
|
|
�8˜gŸo™oÑ-Ô.ð ô �;‰;�sÓ Ð÷ ˆ^ús $B'Â'B0Úshufflec
|
|||
|
|
óJ — |rHt ||z « D �cg c]0 }| j t j |« j « ‘Œ2 }}nCt ||z « D �cg c], }| j ||t |« z j « ‘Œ. }}t
|
|||
|
|
| ||« S c c}w c c}w r? )ÚrangeÚmake_docÚrandomÚchoiceÚtextr. rk )r5 r8 r& r# rl Ú_Ú
|
|||
|
|
bench_docsÚis r: r2 r2 m s® € ñ ô ˜9 zÑ1Ô2ó
|
|||
|
|
á2�ð
|
|||
|
|
�L‰LœŸ ™ tÓ,×1Ñ1Õ 2Ø2ð ñ
|
|||
|
|
ô ˜9 zÑ1Ô2ó
|
|||
|
|
á2�ð
|
|||
|
|
�L‰L˜˜a¤# d£)™mÑ,×1Ñ1Õ 2Ø2ð ð
|
|||
|
|
ô
|
|||
|
|
�C˜ ZÓ 0Ð0ùò
|
|||
|
|
ùò
|
|||
|
|
|
|||
|
|
s “5BÁ1B i' c ót ‡ ‡— t j ˆˆ fd„t |« D « t j « S )z9Apply a statistic to repeated random samples of an array.c 3 ó€ •K — | ]5 } ‰t j j ‰t ‰« d ¬« « –— Œ7 yw)T)ÚreplaceN)rZ rp rq r. )Ú.0rs Ú statisticÚxs €€r: ú <genexpr>z bootstrap.<locals>.<genexpr>… s8 øè ø€ ð
|
|||
|
|
á&�ñ
|
|||
|
|
”e—l‘l×)Ñ)¨!¬S°«V¸TÐ)ÓB× CÙ&ùs ƒ;>)rZ Úfromiterrn Úfloat64)r{ rz Ú
|
|||
|
|
iterationss `` r: Ú bootstrapr€ ‚ s/ ù€ ä �>‰>ô
|
|||
|
|
ä˜:Ô&ó
|