151 lines
18 KiB
Plaintext
151 lines
18 KiB
Plaintext
|
Ë
|
|||
|
|
>û gÐ6 ã
|
|||
|
|
óL — d dl mZ d dlmZmZmZmZmZmZm Z m
|
|||
|
|
Z
|
|||
|
|
d dl Z ddl m
|
|||
|
|
Z
|
|||
|
|
ddlmZ ddlmZ ddlmZ dd lmZ dd
|
|||
|
|
lmZ dd lmZmZ dd lm Z m Z dd
|
|||
|
|
l m Z ddl
|
|||
|
|
m Z m!Z! ddl"m#Z# ddl$m%Z% eee
|
|||
|
|
e&e'f ef Z(ee'e
|
|||
|
|
e(ee&f f Z)ee'ee
|
|||
|
|
e&e'f e
|
|||
|
|
e&e'f f f Z*ee'ee'ee
|
|||
|
|
e&e'f e
|
|||
|
|
e&e'f f f f Z+ ejX ddddidœ¬« dede'de-dee fd „« Z.d ee d ee'ef fd „Z/ e!j` d« d „ « Z1 G d!„ d"e%« Z2d#e3d e e3e3f fd$„Z4y)%é )ÚPath)ÚAnyÚCallableÚDictÚIterableÚListÚOptionalÚTupleÚUnionNé )Úutil)ÚErrors)ÚLanguage)ÚMatcher)ÚScorer)ÚIDS)ÚDocÚSpan)Únormalize_token_attrsÚset_token_attrs)ÚExample)ÚSimpleFrozenListÚregistry)ÚVocabé )ÚPipeÚattribute_rulerFz@scorersz spacy.attribute_ruler_scorer.v1©ÚvalidateÚscorer)Údefault_configÚnlpÚnamer r c ó4 — t | j |||¬« S )Nr )ÚAttributeRulerÚvocab)r" r# r r s ú^C:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/pipeline/attributeruler.pyÚmake_attribute_rulerr( s € ô ˜#Ÿ)™) T°HÀVÔ LÐLó ÚexamplesÚreturnc ó” — d„ }i }|j t j | dfi |¤Ž« |j t j | dfi |¤Ž« |j t j | dfd|i|¤Ž« |j t j | dfd|i|¤Ž« |j t j | dfi |¤Ž« |S )Nc ó. — t | |« j S ©N)ÚgetattrÚkey)ÚtokenÚattrs r' Úmorph_key_getterz/attribute_ruler_score.<locals>.morph_key_getter' s € Ü�u˜dÓ#×'Ñ'Ð'r) ÚtagÚposÚmorphÚgetterÚlemma)Úupdater Úscore_token_attrÚscore_token_attr_per_feat)r* Úkwargsr3 Úresultss r' Úattribute_ruler_scorer> & sÇ € ò(ð €GØ ‡N�N”6×*Ñ*¨8°UÑE¸fÑEÔFØ ‡N�N”6×*Ñ*¨8°UÑE¸fÑEÔFØ ‡N�NÜ× Ñ ¨'ÑUÐ:JÐUÈfÑUôð ‡N�NÜ×(Ñ(Ø �gñ
|
|||
|
|
Ø&6ð
|
|||
|
|
Ø:@ñ
|
|||
|
|
ôð
|
|||
|
|
‡N�N”6×*Ñ*¨8°WÑGÀÑGÔHØ €Nr) c ó — t S r. )r> © r) r' Úmake_attribute_ruler_scorerrA 9 s € ä Ð r) c
|
|||
|
|
óF — e Zd ZdZ d%dedœdedededee dd f
|
|||
|
|
d
|
|||
|
|
„Z
|
|||
|
|
d&d „Z d d d d d œd
|
|||
|
|
ee g e e
|
|||
|
|
f dee dee e dee dee dd f d„Zdedefd„Zdefd„Zd„ Zdeeeeeef eeef f f dd fd„Zdeeeeeeeef eeef f f f dd fd„Z d'de e dededd fd„Z de e dd fd „Z e de e fd „« Z! e"« fd e e de#fd „Z$ e"« fd e#d e e dd fd!„Z% e"« fd"ee&ef d e e dd fd#„Z' e"« fd"ee&ef d e e dd fd$„Z(y )(r% zÂSet token-level attributes for tokens matched by Matcher patterns.
|
|||
|
|
Additionally supports importing patterns from tag maps and morph rules.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler
|
|||
|
|
Fr r& r# r r r+ Nc óž — || _ || _ t | j |¬« | _ || _ g | _ g | _ g | _ || _ y)aç Create the AttributeRuler. After creation, you can add patterns
|
|||
|
|
with the `.initialize()` or `.add_patterns()` methods, or load patterns
|
|||
|
|
with `.from_bytes()` or `.from_disk()`. Loading patterns will remove
|
|||
|
|
any patterns you've added previously.
|
|||
|
|
|
|||
|
|
vocab (Vocab): The vocab.
|
|||
|
|
name (str): The pipe name. Defaults to "attribute_ruler".
|
|||
|
|
scorer (Optional[Callable]): The scoring method. Defaults to
|
|||
|
|
Scorer.score_token_attr for the attributes "tag", "pos", "morph" and
|
|||
|
|
"lemma" and Scorer.score_token_attr_per_feat for the attribute
|
|||
|
|
"morph".
|
|||
|
|
|
|||
|
|
RETURNS (AttributeRuler): The AttributeRuler component.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#init
|
|||
|
|
©r N) r# r& r Úmatcherr ÚattrsÚ_attrs_unnormedÚindicesr )Úselfr& r# r r s r' Ú__init__zAttributeRuler.__init__E sH € ð0 ˆŒ ؈Œ
|
|||
|
|
Ü ˜tŸz™z°HÔ=ˆŒ Ø ˆŒ
|
|||
|
|
Ø!#ˆŒ
|
|||
|
|
Ø+-ˆÔ Ø"$ˆŒ Ø ˆ� r) c óz — t | j | j ¬« | _ g | _ g | _ g | _ y)zReset all patterns.rD N)r r& r rE rF rG rH ©rI s r' ÚclearzAttributeRuler.clearf s. € ä ˜tŸz™z°D·M±MÔBˆŒ ؈Œ
|
|||
|
|
Ø !ˆÔ ؈� r) )r" ÚpatternsÚtag_mapÚ morph_rulesÚ get_examplesr" rN rO rP c ó˜ — | j « |r| j |« |r| j |« |r| j |« yy)a Initialize the attribute ruler by adding zero or more patterns.
|
|||
|
|
|
|||
|
|
Rules can be specified as a sequence of dicts using the `patterns`
|
|||
|
|
keyword argument. You can also provide rules using the "tag map" or
|
|||
|
|
"morph rules" formats supported by spaCy prior to v3.
|
|||
|
|
N)rM Ú add_patternsÚload_from_tag_mapÚload_from_morph_rules)rI rQ r" rN rO rP s r' Ú
|
|||
|
|
initializezAttributeRuler.initializem sE € ð
|
|||
|
|
�
|
|||
|
|
‰
|
|||
|
|
Œ Ù Ø × Ñ ˜hÔ 'Ù Ø × "Ñ " 7Ô +Ù Ø × &Ñ & {Õ 3ð r) Údocc óÆ — | j « } | j |« }| j ||« |S # t $ r } || j | |g|« cY d}~S d}~ww xY w)zÛApply the AttributeRuler to a Doc and set all attribute exceptions.
|
|||
|
|
|
|||
|
|
doc (Doc): The document to process.
|
|||
|
|
RETURNS (Doc): The processed Doc.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#call
|
|||
|
|
N)Úget_error_handlerÚmatchÚset_annotationsÚ Exceptionr# )rI rW Ú
|
|||
|
|
error_handlerÚmatchesÚes r' Ú__call__zAttributeRuler.__call__„ s` € ð ×.Ñ.Ó0ˆ
|
|||
|
|
ð <Ø—j‘j “oˆGØ × Ñ gÔ .؈JøÜò <Ù §¡¨D°3°%¸Ó;Õ ;ûð <ús ’$7 · A Á AÁA ÁA c óÒ — | j |dd¬« }|D ���cg c], \ }}}t | j j | « |||f‘Œ. }}}}|j « |S c c}}}w )NTF)Ú
|
|||
|
|
allow_missingÚas_spans)rE Úintr& ÚstringsÚsort)rI rW r^ Úm_idÚsr_ s r' rZ zAttributeRuler.match” sn € Ø—,‘,˜s°$À�,ÓGˆñ KRõ
|
|||
|
|
ÙJQ¹J¸DÀ!ÀQŒS�—‘×#Ñ# DÑ)Ó
|
|||
|
|
*¨D°!°QÒ 7È'ð ò
|
|||
|
|
ð � ‰ ŒØˆùô
|
|||
|
|
s ›1A"c ó” — |D ]I \ }}}}t ||||¬« }| j | }| j | } || }
|
|||
|
|
t || |« ŒK y# t $ rn t t
|
|||
|
|
j j | j j |j « |D � cg c] } | j ‘Œ nc c} w c} | ¬« « d‚w xY w)z Modify the document in place)Úlabel)rN ÚspanÚindexN)
|
|||
|
|
r rF rH Ú
|
|||
|
|
IndexErrorÚ
|
|||
|
|
ValueErrorr ÚE1001ÚformatrE Úgetrj Útextr ) rI rW r^ Úattr_idÚmatch_idÚstartÚendrk rF rl r1 Úts r' r[ z AttributeRuler.set_annotations� sÌ € ã-4Ñ )ˆG�X˜u cܘ˜U C¨xÔ8ˆDØ—J‘J˜wÑ'ˆEØ—L‘L Ñ)ˆEð
|
|||
|
|
|
|||
|
|
ð ˜U™ �ô
|
|||
|
|
˜D ™K¨Õ /ñ% .5øô ò
|
|||
|
|
ô !Ü—L‘L×'Ñ'Ø!%§ ¡ ×!1Ñ!1°$·*±*Ó!=Ù.2Ó 3©d¨˜aŸf›f©dùÔ 3Ø #ð (ó óð ð
|
|||
|
|
ð
|
|||
|
|
ús ¹AÁACÂ B3Â2Cc ó” — |j « D ]µ \ }}d|ig}t |« \ }}d|vrB| j j j |« }| j j
|
|||
|
|
| |d< nD| j j j |d « }| j j
|
|||
|
|
| |d< | j |g|« Œ· y)zÿLoad attribute ruler patterns from a tag map.
|
|||
|
|
|
|||
|
|
tag_map (dict): The tag map that maps fine-grained tags to
|
|||
|
|
coarse-grained tags and morphological features.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#load_from_morph_rules
|
|||
|
|
ÚTAGÚMORPHN)ÚitemsÚ_split_morph_attrsr& Ú
|
|||
|
|
morphologyÚaddre )rI rO r4 rF ÚpatternÚ morph_attrsr6 s r' rT z AttributeRuler.load_from_tag_map³ s² € ð "Ÿ-™-ž/‰JˆC�Ø ˜s�|�nˆGÜ!3°EÓ!:Ñ ˆE�;ؘeÑ#Ø Ÿ
|
|||
|
|
™
|
|||
|
|
×-Ñ-×1Ñ1°+Ó>�Ø!%§¡×!3Ñ!3°EÑ!:��g’à Ÿ
|
|||
|
|
™
|
|||
|
|
×-Ñ-×1Ñ1°%¸±.ÓA�Ø!%§¡×!3Ñ!3°EÑ!:��g‘Ø �H‰H�g�Y Õ &ñ *r) c óœ — |D ]Ç }|| D ]½ }||dœg}|| | }t |« \ }}d|v rE| j j j |d « }| j j | |d< nC|rA| j j j |« }| j j | |d< | j |g|« Œ¿ ŒÉ y)a+ Load attribute ruler patterns from morph rules.
|
|||
|
|
|
|||
|
|
morph_rules (dict): The morph rules that map token text and
|
|||
|
|
fine-grained tags to coarse-grained tags, lemmas and morphological
|
|||
|
|
features.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#load_from_morph_rules
|
|||
|
|
)ÚORTHry rz N)r| r& r} r~ re )rI rP r4 Úwordr rF r€ r6 s r' rU z$AttributeRuler.load_from_morph_rulesÈ sË € ó ˆCØ# CÔ(�Ø$(°Ñ5Ð6�Ø# CÑ(¨Ñ.�Ü%7¸Ó%>Ñ"��{ؘeÑ#Ø ŸJ™J× 1Ñ 1× 5Ñ 5°e¸G±nÓ E�EØ%)§Z¡Z×%7Ñ%7¸Ñ%>�E˜'’NÙ Ø ŸJ™J× 1Ñ 1× 5Ñ 5°kÓ B�EØ%)§Z¡Z×%7Ñ%7¸Ñ%>�E˜'‘NØ—‘˜'˜ EÕ*ñ )ñ r) rF rl c óŒ — t t | j « « }| j j | j
|
|||
|
|
j j |« |« | j j |« t | j
|
|||
|
|
|« }| j j |« | j j |« y)aB Add Matcher patterns for tokens that should be modified with the
|
|||
|
|
provided attributes. The token at the specified index within the
|
|||
|
|
matched span will be assigned the attributes.
|
|||
|
|
|
|||
|
|
patterns (Iterable[List[Dict]]): A list of Matcher patterns.
|
|||
|
|
attrs (Dict): The attributes to assign to the target token in the
|
|||
|
|
matched span.
|
|||
|
|
index (int): The index of the token in the matched span to modify. May
|
|||
|
|
be negative to index from the end of the span. Defaults to 0.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#add
|
|||
|
|
N) ÚstrÚlenrF rE r~ r& re rG Úappendr rH )rI rN rF rl r0 s r' r~ zAttributeRuler.addà s‡ € ô" ”#�d—j‘j“/Ó"ˆØ � ‰ ×јŸ™×+Ñ+×/Ñ/°Ó4°hÔ?Ø × Ñ ×#Ñ# EÔ*Ü% d§j¡j°%Ó8ˆØ �
|
|||
|
|
‰
|
|||
|
|
×ј%Ô Ø � ‰ ×јEÕ"r) c ó6 — |D ] } | j di |¤Ž Œ y)ac Add patterns from a list of pattern dicts with the keys as the
|
|||
|
|
arguments to AttributeRuler.add.
|
|||
|
|
patterns (Iterable[dict]): A list of pattern dicts with the keys
|
|||
|
|
as the arguments to AttributeRuler.add (patterns/attrs/index) to
|
|||
|
|
add as patterns.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#add_patterns
|
|||
|
|
Nr@ )r~ )rI rN Úps r' rS zAttributeRuler.add_patternsø s € ó ˆAØ ˆD�H‰H‰M�q‹Mñ r) c ó — g }t t | j « « D ]c }i }| j j t |« « d |d< | j | |d< | j | |d< |j |« Œe |S )zAll the added patterns.r rN rF rl ) Úranger† rF rE rq r… rG rH r‡ )rI Ú all_patternsÚir‰ s r' rN zAttributeRuler.patterns s� € ð ˆ Ü”s˜4Ÿ:™:“Ö'ˆA؈AØ ŸL™L× ,Ñ ,¬S°«VÓ 4°QÑ 7ˆAˆj‰MØ ×-Ñ-¨aÑ0ˆAˆg‰JØ Ÿ ™ a™ ˆAˆg‰JØ × Ñ Õ "ð (ð Ðr) Úexcludec óX ‡ ‡— i }ˆˆ fd„|d< ˆ fd„|d< t j |‰« S )zõSerialize the AttributeRuler to a bytestring.
|
|||
|
|
|
|||
|
|
exclude (Iterable[str]): String names of serialization fields to exclude.
|
|||
|
|
RETURNS (bytes): The serialized object.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#to_bytes
|
|||
|
|
c ó< •— ‰j j ‰ ¬« S ©N)rŽ )r& Úto_bytes)rŽ rI s €€r' ú<lambda>z)AttributeRuler.to_bytes.<locals>.<lambda> s ø€ T§Z¡Z×%8Ñ%8ÀÐ%8Ô%Ir) r& c óB •— t j ‰ j « S r. )ÚsrslyÚ
|
|||
|
|
msgpack_dumpsrN rL s €r' r“ z)AttributeRuler.to_bytes.<locals>.<lambda> s ø€ ¬×(;Ñ(;¸D¿M¹MÔ(Jr) rN )r
|
|||
|
|
r’ )rI rŽ Ú serializes `` r' r’ zAttributeRuler.to_bytes s/ ù€ ð ˆ Ü Iˆ �'ÑÛ Jˆ �*Ñ Ü�}‰}˜Y¨Ó0Ð0r) Ú
|
|||
|
|
bytes_datac óT ‡ ‡— ˆ fd„}ˆˆ fd„|dœ}t j ||‰« ‰ S )a' Load the AttributeRuler from a bytestring.
|
|||
|
|
|
|||
|
|
bytes_data (bytes): The data to load.
|
|||
|
|
exclude (Iterable[str]): String names of serialization fields to exclude.
|
|||
|
|
returns (AttributeRuler): The loaded object.
|
|||
|
|
|
|||
|
|
DOCS: https://spacy.io/api/attributeruler#from_bytes
|
|||
|
|
c óN •— ‰j t j | « « y r. )rS r• Ú
|
|||
|
|
msgpack_loads)ÚbrI s €r' Ú
|
|||
|
|
load_patternsz0AttributeRuler.from_bytes.<locals>.load_patterns) s ø€ Ø × Ñ œe× 1Ñ 1°!Ó 4Õ 5r) c ó> •— ‰j j | ‰¬« S r‘ )r& Ú
|
|||
|
|
from_bytes)rœ rŽ rI s €€r' r“ z+AttributeRuler.from_bytes.<locals>.<lambda>- s ø€ ˜tŸz™z× 4Ñ 4°QÀÐ 4Ô Hr) ©r& rN )r
|
|||
|
|
rŸ )rI r˜ rŽ r� Ú deserializes ` ` r' rŸ zAttributeRuler.from_bytes s/ ù€ ô 6ô IØ%ñ
|
|||
|
|
ˆ ô
|
|||
|
|
�‰˜
|
|||
|
|
K°Ô9؈ r) Úpathc óN ‡ ‡— ˆˆ fd„ˆ fd„dœ}t j ||‰« y)zôSerialize the AttributeRuler to disk.
|
|||
|
|
|
|||
|
|
path (Union[Path, str]): A path to a directory.
|
|||
|
|
exclude (Iterable[str]): String names of serialization fields to exclude.
|
|||
|
|
|