143 lines
21 KiB
Plaintext
143 lines
21 KiB
Plaintext
|
Ë
|
|||
|
|
>û gXG ã óR — d dl Z d dlZd dlmZ d dlmZmZmZ d dlm Z d dl
|
|||
|
|
m Z d dl m
|
|||
|
|
Z
|
|||
|
|
mZ ej j! d« d„ « Zej j! d « d
|
|||
|
|
„ « Zej j! d « d „ « Zej j! d
|
|||
|
|
« d„ « Zej j! d« d„ « Zej j! d« d„ « Zej j! d« d„ « Zd„ Zd„ Zd„ Zd„ Zd„ Z d„ Z d„ Z d „ Z d „ Z d „ Z!d „ Z"d „ Z#d!„ Z$d"„ Z%d#„ Z&d$„ Z'ej j! d%« d&„ « Z(ej j! d'« d+d(„« Z)ej j! d)« d*„ « Z*y),é N)Údisplacy)ÚDependencyRendererÚEntityRendererÚ SpanRenderer)ÚEnglish)ÚPersian)ÚDocÚSpani9 c óŠ — d}g d¢}t | |dgt |« z ¬« }t j |« }|D ] }||v rŒJ ‚ y)z#Test if < is escaped when rendering)z<z>z&z")ú<ú>ú&ú"Údep©ÚwordsÚdepsN)r Úlenr Úrender)Úde_vocabÚcharsr ÚdocÚhtmlÚchars úZC:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/tests/test_displacy.pyÚtest_issue2361r sK € ð
|
|||
|
|
0€EÚ €EÜ
|
|||
|
|
|
|||
|
|
ˆh˜e¨5¨'´C¸³JÑ*>Ô
|
|||
|
|
?€CÜ �?‰?˜3Ó €DÛˆØ�tŠ|Ј|ñ ó i¨
|
|||
|
|
c óê — t | g d¢¬« }t |ddd¬« g|_ t j |d¬« }d |v sJ ‚t |dd
|
|||
|
|
d¬« g|_ t j |d¬« }d |v sJ ‚y ) z9Test that displaCy ENT visualizer escapes HTML correctly.)Útestz <RELEASE>r ©r r é ÚTEST©ÚlabelÚent©Ústylez<RELEASE>é N)r r
|
|||
|
|
Úentsr r ©Úen_vocabr r s r Útest_issue2728r, sw € ô ˆhÒ ;Ô
|
|||
|
|
<€CÜ�S˜!˜Q fÔ-Ð.€C„HÜ �?‰?˜3 eÔ ,€DØ Ñ $Ð$Ð $Ü�S˜!˜Q fÔ-Ð.€C„HÜ �?‰?˜3 eÔ ,€DØ Ñ $Ð$Ñ $r iØ c ó² — g d¢}g d¢}g d¢}t | |||¬« }t j t |« dfd¬« |_ t j |« y) z…Test that retokenization works correctly via displaCy when punctuation
|
|||
|
|
is merged onto the preceeding token and tensor is resized.)ÚHelloÚWorldú!ÚWhenÚisÚthisÚbreakingú?)r! r! r! é r6 é r6 r6 )ÚintjÚROOTÚpunctÚadvmodr9 ÚdetÚnsubjr: )r Úheadsr é` Úfloat32)ÚdtypeN)r ÚnumpyÚzerosr Útensorr r )r+ r r> r r s r Útest_issue3288rE " sK € ò
|
|||
|
|
K€EÚ $€EÚ O€DÜ
|
|||
|
|
|
|||
|
|
ˆh˜e¨5°tÔ
|
|||
|
|
<€CÜ—‘œc %›j¨"Ð -°YÔ?€C„JÜ ‡O�O�CÕr iË
|
|||
|
|
c
|
|||
|
|
óþ — dddœdddœdddœdddœd d
|
|||
|
|
dœd d dœgd
|
|||
|
|
ddddœdddddœdddddœdddddœdddddœgdœ} d dd d d œgd œ}t j | d!d"¬#« }|sJ ‚t j |d$d"¬#« }|sJ ‚y%)&z;Test that displaCy renderer doesn't require "settings" key.ÚButÚCCONJ©ÚtextÚtagÚGoogleÚPROPNr2 ÚVERBÚstartingÚfromÚADPzbehind.ÚADVr é ÚccÚleft©ÚstartÚendr$ Údirr! r= r( Úauxr6 ÚprepÚrighté Úpcomp©r Úarcsú#But Google is starting from behind.é
|
|||
|
|
ÚORG©rW rX r$ ©rJ r) r T©r' Úmanualr% N©r r )Ú example_depÚ example_entÚdep_htmlÚent_htmls r Útest_issue3531rm . sÐ € ð
|
|||
|
|
7Ñ +Ø gÑ .Ø &Ñ )Ø ¨Ñ /Ø EÑ *Ø uÑ -ð
|
|||
|
|
|
|||
|
|
ð ¨D¸Ñ @Ø ¨G¸FÑ CØ ¨E¸&Ñ AØ ¨F¸7Ñ CØ ¨G¸GÑ Dð
|
|||
|
|
ñ€Kð$ 6Ø R°%Ñ8Ð9ñ€Kô �‰˜{°%ÀÔE€HÙ €Oˆ8Ü�‰˜{°%ÀÔE€HÙ €O‰8r i* c ó€ — t | ddgddg¬« }t « |j d< t j |« y)z^Test that displaCy doesn't serialize the doc.user_data when making a
|
|||
|
|
copy of the Doc.
|
|||
|
|
r. Úworldr r r N)r ÚsetÚ user_datar Ú
|
|||
|
|
parse_deps)r+ r s r Útest_issue3882rs L s9 € ô
|
|||
|
|
ˆh˜w¨Ð 0¸¸u°~Ô
|
|||
|
|
F€CÜ ›E€C‡M�M�&ÑÜ ×Ñ˜Õ r iG c óÈ — t « } dddœdddœdddœdddœg}d d
|
|||
|
|
d d d
|
|||
|
|
œdddd d
|
|||
|
|
œdddd d
|
|||
|
|
œdddd dœd
|
|||
|
|
ddd d
|
|||
|
|
œg}| j ||dœg« | j dk( sJ ‚y)zITest that overlapping arcs get separate levels, unless they're identical.ÚThisÚDTrI r2 ÚVBZÚaz sentence.ÚNNr r! r= rU rV r( rS r< Úoverlap)rX r$ rW rY Úattrr_ N)r r Ú
|
|||
|
|
highest_level©Úrendererr r` s r Útest_issue5447r V s¢ € ô "Ó#€Hà Ñ%ؘeÑ$ؘTÑ"Ø TÑ*ð
|
|||
|
|
€Eð ˜A¨¸Ñ?ؘA¨°fÑ=ؘA¨ ¸&ÑAؘI°¸&ÑAؘA¨°vÑ>ð €Dð
|
|||
|
|
‡O�O˜u¨dÑ3Ð4Ô5Ø × !Ñ ! QÒ &Ð&Ñ &r iÎ c ó´ — d} t « } || « }t |ddd¬« g|_ t j |d¬« }|j d« }|d k( sJ ‚y )
|
|||
|
|
Nz8First line
|
|||
|
|
Second line, with ent
|
|||
|
|
Third line
|
|||
|
|
Fourth line
|
|||
|
|
é é r r# r% r& z<br>r6 )r r
|
|||
|
|
r) r r Úcount)Ú sample_textÚnlpr r Úfounds r Útest_issue5838r‡ k sZ € ð Q€KÜ
|
|||
|
|
‹)€CÙ
|
|||
|
|
|
|||
|
|
ˆkÓ
|
|||
|
|
€CÜ�S˜!˜Q fÔ-Ð.€C„HÜ �?‰?˜3 eÔ ,€DØ �J‰J�vÓ €EØ �AŠ:Љ:r c
|
|||
|
|
ó — t | g d¢¬« }t |ddd« t |ddd« g|j d< t j |« }t |t « sJ ‚|d d
|
|||
|
|
k( sJ ‚|d d d
|
|||
|
|
ddddddœdd
|
|||
|
|
ddddddœgk( sJ ‚y)z>Test that spans on a Doc are converted into displaCy's format.©ÚWelcomeÚtoÚtheÚBankÚofÚChinar rS r7 rc r] ÚGPEÚscrJ ú Welcome to the Bank of China Úspansé é Ú ú#©rW rX Ú start_tokenÚ end_tokenr$ Úkb_idÚkb_urlé N©r r
|
|||
|
|
r“ r Ú parse_spansÚ
|
|||
|
|
isinstanceÚdict©r+ r r“ s r Útest_displacy_parse_spansr£ x s» € ä
|
|||
|
|
|
|||
|
|
ˆhÒ MÔ
|
|||
|
|
N€CܘC A uÓ-¬t°C¸¸A¸uÓ/EÐF€C‡I�Iˆd�OÜ × Ñ Ó %€EÜ �eœTÔ "Ð"Ð "Ø �‰=Ð ;Ò ;Ð;Ð ;Ø �‰>àØØ ØØØØñ
|
|||
|
|
ð ØØ ØØØØñ
|
|||
|
|
ð ò ð ñ r c
|
|||
|
|
ó — t | g d¢¬« }t |dddd¬« t |ddd d
|
|||
|
|
¬« g|j d < t j |d d
|
|||
|
|
i« }t |t « sJ ‚|d dk( sJ ‚|d ddddddddœddddd d
|
|||
|
|
ddœgk( sJ ‚y)zHTest that spans with kb_id on a Doc are converted into displaCy's formatr‰ r rS r7 rc ÚQ790068)r› r] r� ÚQ148r‘ Úkb_url_templatez https://wikidata.org/wiki/{}rJ r’ r“ r” r• z!https://wikidata.org/wiki/Q790068r˜ r� z https://wikidata.org/wiki/Q148Nrž r¢ s r Ú,test_displacy_parse_spans_with_kb_id_optionsr¨ • sÒ € ä
|
|||
|
|
|
|||
|
|
ˆhÒ MÔ
|
|||
|
|
N€Cä ˆS�!�Q˜ YÔ/Ü ˆS�!�Q˜ VÔ,ð€C‡I�Iˆd�Oô
|
|||
|
|
|
|||
|
|
× Ñ Ø Ð Ð!?Ð
|
|||
|
|
@ó
|
|||
|
|
€Eô �eœTÔ "Ð"Ð "Ø �‰=Ð ;Ò ;Ð;Ð ;Ø �‰>àØØ ØØØ Ø9ñ
|
|||
|
|
ð ØØ ØØØØ6ñ
|
|||
|
|
ð ò ð ñ r c ó< — t | g d¢¬« }t |ddd« t |ddd« g|j d< t |ddd « g|j d
|
|||
|
|
< t j |d d
|
|||
|
|
i¬ « }t |t « sJ ‚|d
|
|||
|
|
dk( sJ ‚|d ddddd dddœgk( sJ ‚y)z7Test that spans in a different spans key will be parsedr‰ r rS r7 rc r] r� r‘ ÚBANKÚcustomÚ spans_key)ÚoptionsrJ r’ r“ r” r• r– r— r˜ Nrž r¢ s r Ú-test_displacy_parse_spans_different_spans_keyr® ¸ s € ä
|
|||
|
|
|
|||
|
|
ˆhÒ MÔ
|
|||
|
|
N€CܘC A uÓ-¬t°C¸¸A¸uÓ/EÐF€C‡I�Iˆd�OÜ Q¨¨6Ó2Ð3€C‡I�IˆhÑÜ × Ñ ¨{¸HÐ.EÔ F€Eä �eœTÔ "Ð"Ð "Ø �‰=Ð ;Ò ;Ð;Ð ;Ø �‰>àØØ ØØØØñ
|
|||
|
|
ð
|
|||
|
|
ò
|
|||
|
|
ð
|
|||
|
|
ñ
|
|||
|
|
r c ó — t | g d¢¬« }t |ddd« g|j d< t j t
|
|||
|
|
d¬« 5 t
|
|||
|
|
j |« }d d d « t t « sJ ‚y # 1 sw Y Œ xY w)
|
|||
|
|
z:Test that having an unset spans key doesn't raise an errorr‰ r rS r7 rª r« ÚW117)ÚmatchN)
|
|||
|
|
r r
|
|||
|
|
r“ ÚpytestÚwarnsÚ UserWarningr rŸ r r¡ r¢ s r Ú#test_displacy_parse_empty_spans_keyrµ Î si € ä
|
|||
|
|
|
|||
|
|
ˆhÒ MÔ
|
|||
|
|
N€CÜ Q¨¨6Ó2Ð3€C‡I�IˆhÑÜ � ‰ ”k¨Ö 0Ü×$Ñ$ SÓ)ˆ÷
|
|||
|
|
1ô �eœTÔ "Ð"Ñ "÷
|
|||
|
|
1Ð 0ús ÁA8Á8Bc óÜ — t | g d¢¬« }t |dd|j j d ¬« g|_ t j |« }t |t « sJ ‚|d dk( sJ ‚|d d
|
|||
|
|
d dd d
|
|||
|
|
dœgk( sJ ‚t |dd|j j d d¬« g|_ t j |« }t |t « sJ ‚|d dk( sJ ‚|d d
|
|||
|
|
d ddd
|
|||
|
|
dœgk( sJ ‚y)zGTest that named entities on a Doc are converted into displaCy's format.©rG rL r2 rO rP Úbehindr r! r( rc r# rJ ú#But Google is starting from behind r) r6 rb r– r— ©rW rX r$ r› rœ ÚQ95©r$ r› N© r r
|
|||
|
|
ÚvocabÚstringsr) r Ú
|
|||
|
|
parse_entsr r¡ ©r+ r r) s r Útest_displacy_parse_entsrÂ Ø s € ä
|
|||
|
|
|
|||
|
|
ˆhÒ SÔ
|
|||
|
|
T€CÜ�S˜!˜Q c§i¡i×&7Ñ&7¸Ñ&>Ô?Ð@€C„HÜ × Ñ ˜sÓ #€DÜ �dœDÔ !Ð!Ð !Ø �‰<Ð@Ò @Ð@Ð @Ø �‰<ؘB¨¸ÀsÑKð ò ð ð ô �S˜!˜Q c§i¡i×&7Ñ&7¸Ñ&>ÀeÔLÐM€C„HÜ × Ñ ˜sÓ #€DÜ �dœDÔ !Ð!Ð !Ø �‰<Ð@Ò @Ð@Ð @Ø �‰<ؘB¨¸È#ÑNð ò ð ñ r c ó — t | g d¢¬« }t |dd|j j d d¬« g|_ t j |dd i« }t |t « sJ ‚|d
|
|||
|
|
d k( sJ ‚|d d
|
|||
|
|
dddddœgk( sJ ‚y)zRTest that named entities with kb_id on a Doc are converted into displaCy's format.r· r r! r( rc r» r¼ r§ z https://www.wikidata.org/wiki/{}rJ r¹ r) r6 rb z!https://www.wikidata.org/wiki/Q95rº Nr½ rÁ s r Ú+test_displacy_parse_ents_with_kb_id_optionsrÄ ì s¥ € ä
|
|||
|
|
|
|||
|
|
ˆhÒ SÔ
|
|||
|
|
T€CÜ�S˜!˜Q c§i¡i×&7Ñ&7¸Ñ&>ÀeÔLÐM€C„Hä × Ñ Ø Ð Ð!CÐ
|
|||
|
|
Dó €Dô �dœDÔ !Ð!Ð !Ø �‰<Ð@Ò @Ð@Ð @Ø �‰<àØØØØ9ñ
|
|||
|
|
ð ò ð ñ r c ó8 — g d¢}g d¢}g d¢}g d¢}g d¢}t | |||||¬« }t j |« }t |t « sJ ‚|d d|d |d d
|
|||
|
|
œd|d |d d
|
|||
|
|
œd|d |d d
|
|||
|
|
œd|d
|
|||
|
|
|d
|
|||
|
|
d
|
|||
|
|
œgk( sJ ‚|d d d dddœd d
|
|||
|
|
dddœd d
|
|||
|
|
dddœgk( sJ ‚t j |dd « }t |t « sJ ‚|d d|d |d d
|
|||
|
|
œd|d |d d
|
|||
|
|
œd|d |d d
|
|||
|
|
œd|d
|
|||
|
|
|d
|
|||
|
|
d
|
|||
|
|
œgk( sJ ‚|d d d dddœd d
|
|||
|
|
dddœd d
|
|||
|
|
dddœgk( sJ ‚y)zFTest that deps and tags on a Doc are converted into displaCy's format.)ru r2 rx Úsentence)r! r! rS r! )ÚDETrN rÇ ÚNOUN)rv rw rv ry )r= r9 r< r{ )r r> ÚposÚtagsr r Nr )ÚlemmarJ rK r! r( rS r` r= rU rV r< r{ r\ )r r rr r r¡ )r+ r r> rÉ rÊ r r s r Útest_displacy_parse_depsrÌ s½ € â +€EÚ €EÚ
|
|||
|
|
(€CÚ $€DÚ +€DÜ
|
|||
|
|
|
|||
|
|
ˆh˜e¨5°cÀÈ4Ô
|
|||
|
|
P€CÜ × Ñ ˜sÓ #€DÜ �dœDÔ !Ð!Ð !Ø �‰=Ø a¡°°Q±Ñ8Ø a¡°°Q±Ñ8Ø a¡°°Q±Ñ8Ø a¡°°Q±Ñ8ð ò ð ð ð �‰<ؘA¨¸Ñ?ؘA¨°fÑ=ؘA¨°wÑ?ð ò ð ð ô × Ñ ˜s¡1˜vÓ &€DÜ �dœDÔ !Ð!Ð !Ø �‰=Ø a¡°°Q±Ñ8Ø a¡°°Q±Ñ8Ø a¡°°Q±Ñ8Ø a¡°°Q±Ñ8ð ò ð ð ð �‰<ؘA¨¸Ñ?ؘA¨°fÑ=ؘA¨°wÑ?ð ò ð ñ r c óÎ — t « } dddœdddœg}dddd d
|
|||
|
|
œd d d
|
|||
|
|
d d
|
|||
|
|
œg}t j t « 5 | j ||dœg« d d d « y # 1 sw Y y xY w)Nru rÇ rI r2 rN r r! r= rU rV éÿÿÿÿr( r< r_ )r r² ÚraisesÚ
|
|||
|
|
ValueErrorr r} s r Útest_displacy_invalid_arcsrÑ & sk € Ü!Ó#€HØ UÑ
|
|||
|
|
+°dÀ6Ñ-JÐ K€Eà˜A¨¸Ñ?ؘQ¨°vÑ>ð €Dô
|
|||
|
|
� ‰ ”zÕ "Ø�‰ 5°$Ñ7Ð8Ô9÷
|
|||
|
|
#× "Ñ "ús ¼AÁA$c óÔ — t | g d¢¬« }t |dd|j j d ¬« g|_ t j |dd d¬ « }|j d
|
|||
|
|
« sJ ‚y ) z$Test that displaCy can render Spans.r· r r! r( rc r# r6 r% r& z<divN)r r
|
|||
|
|
r¾ r¿ r) r r Ú
|