34 lines
9.6 KiB
Plaintext
34 lines
9.6 KiB
Plaintext
|
Ë
|
|||
|
|
?û g ã óØ — d dl Z d dlmZ g d¢Zeg d¢z Zg d‘d‘d‘d‘d ‘d
|
|||
|
|
‘d ‘d ‘d
|
|||
|
|
‘d‘d‘d‘d‘d‘d‘d‘d‘d‘d‘d‘d‘d‘d‘d ‘d ‘d ‘d ‘d ‘d!‘d"‘ e j
|
|||
|
|
d#e j j « ¬$« ‘ e j
|
|||
|
|
d%e j j « ¬$« ‘d&‘d'‘d(‘d)‘d*‘d+‘d,‘d-‘d.‘d/‘d0‘d1‘d2‘Zg d3‘d4‘d5‘d6‘d7‘d8‘d9‘d:‘d;‘d<‘d=‘d>‘d?‘d@‘dA‘dB‘dC‘dD‘dE‘dF‘dG‘dH‘dI‘dJ‘dK‘dL‘dM‘dN‘dO‘dP‘dQ‘dR‘dS‘dT‘ e j
|
|||
|
|
dUe j j « ¬$« ‘dV‘dW‘Z g dX¢Z
|
|||
|
|
g dY¢Z e j j dZe« d[„ « Z
|
|||
|
|
e j j dZe « d\„ « Ze j j dZe« d]„ « Ze j j dZe« d^„ « Ze j j" e j j d_e
|
|||
|
|
« e j j dZe« d`„ « « « Ze j j" e j j dae « e j j dZe« db„ « « « Ze j j" e j j d_e
|
|||
|
|
« e j j dae « e j j dZe« dc„ « « « « Ze j j" e j j dde
|
|||
|
|
« e j j dee
|
|||
|
|
« e j j dZe« df„ « « « « Ze j j" e j j dge « e j j dhe « e j j dZe« di„ « « « « Zy)jé N)ÚBASE_EXCEPTIONS)zÇhttp://www.nytimes.com/2016/04/20/us/politics/new-york-primary-preview.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region®ion=top-news&WT.nav=top-news&_r=0zwww.red-stars.comzmailto:foo.bar@baz.com)zmailto:foo-bar@baz-co.comz$mailto:foo-bar@baz-co.com?subject=hizwww.google.com?q=googleú&http://foo.com/blah_(wikipedia)#cite-1zhttp://foo.com/blah_blahz http://BlahBlah.com/Blah_Blahzhttp://foo.com/blah_blah/z%http://www.example.com/wpstyle/?p=364z1https://www.example.com/foo/?bar=baz&inga=42&quuxz'http://userid:password@example.com:8080z(http://userid:password@example.com:8080/zhttp://userid@example.comzhttp://userid@example.com/z http://userid@example.com:8080z http://userid@example.com:8080/z"http://userid:password@example.comz#http://userid:password@example.com/zhttp://142.42.1.1/zhttp://142.42.1.1:8080/r z+http://foo.com/blah_(wikipedia)_blah#cite-1u& http://foo.com/unicode_(✪)_in_parensz'http://foo.com/(something)?after=parensz/http://code.google.com/events/#&product=browserz http://j.mpzftp://foo.bar/bazz,http://foo.bar/?q=Test%20URL-encoded%20stuffz2http://-.~_!$&'()*+,;=:%40:80%2f::::::@example.comzhttp://1337.netzhttp://a.b-c.dezhttp://223.255.255.254zhttp://a.b--c.de/z+ssh://login@server.com:12345/repository.gitz&svn+ssh://user@ssh.yourdomain.com/pathz8chrome://extensions/?id=mhjfbmdgcfjbbpaeojofohoefgiehjai)Úmarksz3chrome-extension://mhjfbmdgcfjbbpaeojofohoefgiehjaiz$http://foo.com/blah_blah_(wikipedia)z,http://foo.com/blah_blah_(wikipedia)_(again)zhttp://www.foo.co.ukzhttp://www.foo.co.uk/z http://www.foo.co.uk/blah/blahu
|
|||
|
|
http://⌘.wsu http://⌘.ws/u http://☺.damowmow.com/u http://✪df.ws/123u http://âž¡.ws/䨹u http://مثال.إختبارu http://例å�.测试u/ http://उदाहरण.परीकà¥�षाzhttp://zhttp://.z http://..z
|
|||
|
|
http://../zhttp://?z http://??z
|
|||
|
|
http://??/zhttp://#z http://##z
|
|||
|
|
http://##/z)http://foo.bar?q=Spaces should be encodedz//z//az///az///z http:///az rdar://1234zh://testzhttp:// shouldfail.comz:// should failz http://foo.bar/foo(bar)baz quuxzhttp://-error-.invalid/zhttp://a.b-.cozhttp://0.0.0.0zhttp://10.1.1.0zhttp://10.1.1.255zhttp://224.1.1.1zhttp://123.123.123zhttp://3628126748zhttp://.www.foo.bar/zhttp://.www.foo.bar./zhttp://10.1.1.1z NASDAQ:GOOGzhttp://-a.b.cozfoo.comzhttp://1.1.1.1.1zhttp://www.foo.bar./)ú(ú"ú>)r ú:r Úurlc ó* — | j |« €J ‚y ©N©Ú url_match©Ú en_tokenizerr
|
|||
|
|
s ú`C:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/tests/tokenizer/test_urls.pyÚtest_should_matchr y s € à × !Ñ ! #Ó &Ð 2Ð2Ñ 2ó c ó* — | j |« �J ‚y r r
|
|||
|
|
r s r Útest_should_not_matchr ~ s € à × !Ñ ! #Ó &Ð .Ð.Ñ .r c ó\ — | |« }t |« dk( sJ ‚|d j |k( sJ ‚y )Né r ©ÚlenÚtext©Ú tokenizerr
|
|||
|
|
Útokenss r Ú!test_tokenizer_handles_simple_urlr ƒ s3 € á
|
|||
|
|
�s‹^€FÜ ˆv‹;˜!Ò ÐÐ Ø �!‰9�>‰>˜SÒ Ð Ñ r c ó¸ — | d|z dz « }t |« dk( sJ ‚|d j dk( sJ ‚|d j |k( sJ ‚|d j dk( sJ ‚y )Nr ú)é r r é r r s r Ú*test_tokenizer_handles_simple_surround_urlr# Š sh € á
|
|||
|
|
�s˜S‘y 3‘Ó
|
|||
|
|
'€FÜ ˆv‹;˜!Ò ÐÐ Ø �!‰9�>‰>˜SÒ Ð Ð Ø �!‰9�>‰>˜SÒ Ð Ð Ø �!‰9�>‰>˜SÒ Ð Ñ r Úprefixc óŠ — | ||z « }t |« dk( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚y ©Nr" r r r )r r$ r
|
|||
|
|
r s r Ú#test_tokenizer_handles_prefixed_urlr' “ sP € ñ �v ‘|Ó
|
|||
|
|
$€FÜ ˆv‹;˜!Ò ÐÐ Ø �!‰9�>‰>˜VÒ #Ð#Ð #Ø �!‰9�>‰>˜SÒ Ð Ñ r Úsuffixc óŠ — | ||z « }t |« dk( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚y r& r )r r
|
|||
|
|
r( r s r Ú#test_tokenizer_handles_suffixed_urlr* � sP € ñ �s˜V‘|Ó
|
|||
|
|
$€FÜ ˆv‹;˜!Ò ÐÐ Ø �!‰9�>‰>˜SÒ Ð Ð Ø �!‰9�>‰>˜VÒ #Ð#Ñ #r c ó¸ — | ||z |z « }t |« dk( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚y ©Nr! r r r" r )r r$ r( r
|
|||
|
|
r s r Ú#test_tokenizer_handles_surround_urlr- § sk € ñ
|
|||
|
|
�v ‘| fÑ,Ó
|
|||
|
|
-€FÜ ˆv‹;˜!Ò ÐÐ Ø �!‰9�>‰>˜VÒ #Ð#Ð #Ø �!‰9�>‰>˜SÒ Ð Ð Ø �!‰9�>‰>˜VÒ #Ð#Ñ #r Úprefix1Úprefix2c ó¸ — | ||z |z « }t |« dk( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚y r, r )r r. r/ r
|
|||
|
|
r s r Ú%test_tokenizer_handles_two_prefix_urlr1 ³ sl € ñ
|
|||
|
|
�w Ñ(¨3Ñ.Ó
|
|||
|
|
/€FÜ ˆv‹;˜!Ò ÐÐ Ø �!‰9�>‰>˜WÒ $Ð$Ð $Ø �!‰9�>‰>˜WÒ $Ð$Ð $Ø �!‰9�>‰>˜SÒ Ð Ñ r Úsuffix1Úsuffix2c óF — | ||z |z « }||z t v r<t |« dk( sJ ‚|d j |k( sJ ‚|d j ||z k( sJ ‚y t |« dk( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚|d j |k( sJ ‚y )Nr" r r r! )r r r )r r2 r3 r
|
|||
|
|
r s r Ú%test_tokenizer_handles_two_suffix_urlr5 ¿ s» € ñ
|