60 lines
6.7 KiB
Plaintext
60 lines
6.7 KiB
Plaintext
|
Ë
|
|||
|
|
=û g” ã óZ — d dl mZ d dlmZ d dlmZmZmZmZm Z d dl
|
|||
|
|
Z
|
|||
|
|
d dl Z d dl m
|
|||
|
|
Z
|
|||
|
|
ddlmZmZ ddlmZmZ dd lmZ d
|
|||
|
|
d lmZmZmZmZmZm Z d Z d
|
|||
|
|
Z dZ dZ dZ!eee" ee f Z#dededee fd„Z$dede"dee" fd„Z%dee dee" fd„Z& ejN d« edd¬ « ede d ¬ « ede d ¬ « edd!d"e ¬ « ed#d$d%d&¬ « ed d'd(d)¬ « ed*d+d,d-¬ « ed
|
|||
|
|
d.d/d0¬ « ed
|
|||
|
|
d1d2d3¬ « f d4e"d5ed6ed7ee d8e"d9e(d:e)d;e)d<e)fd=„« Z*d5ed6ed4e"d>e"d;e)d<e)f d?„Z+y)@é )Úchain)ÚPath)ÚIterableÚListÚOptionalÚUnionÚcastN)Úmsgé )ÚDocÚDocBin)Ú ensure_pathÚ
|
|||
|
|
load_model)ÚVocabé )ÚArgÚOptÚappÚ import_codeÚ setup_gpuÚwalk_directorya• Location of the documents to predict on.
|
|||
|
|
Can be a single file in .spacy format or a .jsonl file.
|
|||
|
|
Files with other extensions are treated as single plain text documents.
|
|||
|
|
If a directory is provided it is traversed recursively to grab
|
|||
|
|
all files to be processed.
|
|||
|
|
The files can be a mixture of .spacy, .jsonl and text files.
|
|||
|
|
If .jsonl is provided the specified field is going
|
|||
|
|
to be grabbed ("text" by default).z&Path to save the resulting .spacy filezNPath to Python file with additional code (registered functions) to be importedz3Use gold preprocessing provided in the .spacy fileszjThe provided output file already exists. To force overwriting the output file, set the --force or -F flag.ÚpathÚvocabÚreturnc # ór K — t « j | « }|j |« D ] }|–— Œ yw)z)
|
|||
|
|
Stream Doc objects from DocBin.
|
|||
|
|
N)r
|
|||
|
|
Ú from_diskÚget_docs)r r ÚdocbinÚdocs úPC:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/cli/apply.pyÚ_stream_docbinr! % s2 è ø€ ô ‹X×
|
|||
|
|
Ñ
|
|||
|
|
Ó
|
|||
|
|
%€FØ�‰˜uÖ%ˆØ‹ ñ &ùs ‚57Úfieldc # ó’ K — t j | « D ]+ }||vr t j | › d|› d�d¬« Œ%|| –— Œ- yw)z_
|
|||
|
|
Stream "text" field from JSONL. If the field "text" is
|
|||
|
|
not found it raises error.
|
|||
|
|
z does not contain the required 'z' field.r ©ÚexitsN)ÚsrslyÚ
|
|||
|
|
read_jsonlr
|
|||
|
|
Úfail)r r" Úentrys r Ú
|
|||
|
|
_stream_jsonlr* . sL è ø€ ô
|
|||
|
|
×!Ñ! $Ö'ˆØ ˜Ñ Ü �H‰H˜�vÐ =¸e¸WÀHÐMÐUVÖ Wà˜‘,Ó ñ (ùs ‚AAÚpathsc # ó„ K — | D ]+ }t |d« 5 }|j « }|–— ddd« Œ- y# 1 sw Y Œ8xY ww)z2
|
|||
|
|
Yields strings from text files in paths.
|
|||
|
|
ÚrN)ÚopenÚread)r+ r ÚfinÚtexts r Ú
|
|||
|
|
_stream_textsr2 : s9 è ø€ ó ˆÜ
|
|||
|
|
�$˜Œ_ Ø—8‘8“:ˆDØŠJ÷ ˆ_ñ ß
|
|||
|
|
ˆ_üs ‚A ”4© A ´= ¹A Úapply.zModel name or path)ÚhelpT)r4 ÚexistsF)r4 Údir_okayz--codez-cr1 z
|
|||
|
|
--text-keyz-tkz$Key containing text string for JSONLz--forcez-Fz!Force overwriting the output fileéÿÿÿÿz--gpu-idz-gzGPU ID or -1 for CPU.z --batch-sizez-bz Batch size.z --n-processz-nz number of processors to use.ÚmodelÚ data_pathÚ output_fileÚ code_pathÚtext_keyÚforce_overwriteÚuse_gpuÚ
|
|||
|
|
batch_sizeÚ n_processc ó@ — t |« }t |« }t |« }|j « r |st j t d¬« |j « st j d|› �d¬« t |« t
|
|||
|
|
|« t ||| |||« y)aÍ
|
|||
|
|
Apply a trained pipeline to documents to get predictions.
|
|||
|
|
Expects a loadable spaCy pipeline and path to the data, which
|
|||
|
|
can be a directory or a file.
|
|||
|
|
The data files can be provided in multiple formats:
|
|||
|
|
1. .spacy files
|
|||
|
|
2. .jsonl files with a specified "field" to read the text from.
|
|||
|
|
3. Files with any other extension are assumed to be containing
|
|||
|
|
a single document.
|
|||
|
|
DOCS: https://spacy.io/api/cli#apply
|
|||
|
|
r r$ zCouldn't find data path: N)r r5 r
|
|||
|
|
r( Ú force_msgr r r3 ) r8 r9 r: r; r< r= r> r? r@ s r Ú apply_clirC D s‚ € ô0 ˜IÓ&€IÜ ˜kÓ*€KܘIÓ&€IØ×ÑÔ¡OÜ �‰” !Õ$Ø × Ñ Ô Ü �‰Ð,¨Y¨KÐ8ÀÕBÜ� ÔÜ
|
|||
|
|
ˆgÔÜ ˆ)�[ %¨°:¸yÕIó Ú
|
|||
|
|
json_fieldc óB — t d¬« }t | « }t |« dk( r+|j |« t j
|
|||
|
|
d| › d�« y t
|
|||
|
|
|« }t j d|› �« |j } g }
|
|||
|
|
g } |D ]i } | j dk( r |
|
|||
|
|
j t | | « « Œ.| j dk( r |
|
|||
|
|
j t | |« « ŒY| j | « Œk t | « dkD r|
|
|||
|
|
j t | « « t t t! |
|
|||
|
|
Ž « }
|
|||
|
|
t# j" |j% |
|