INTUIA/Programa final/spacy/training/__pycache__/batchers.cpython-312.pyc

Ë
?û gœ$ãó<—dd
lZddl
mZ
ddlmZmZmZmZmZm	Z	m
Z
mZmZ
ddl
mZmZ
ee
eefZed«
Zeeeg
eeefZej(d«
d
dœ
d	ed
edede	eeg
efd
ef
d„«Zej(d«
d
dœ
d	ededede	eeg
efd
ef
d„«Zej(d«
	dd	ede	eeg
efd
efd„«Zddefdeed	ed
ededed
eeefd„Zddefdeed	ed
eeefd„Zef
de
eded
eeefd„Zy
)éN)
Úpartial)	ÚAnyÚCallableÚIterableÚIteratorÚListÚOptionalÚSequenceÚTypeVarÚUnioné)Ú	minibatchÚregistryÚItemTzspacy.batch_by_padded.v1)
Ú
get_lengthÚsizeÚbufferÚdiscard_oversizerÚreturncó:—|�d
|i
n
i}t
tf
||
|dœ|¤
Ž
S)a‰Create a batcher that uses the `batch_by_padded_size` strategy.

    The padded size is defined as the maximum length of sequences within the
    batch multiplied by the number of sequences in the batch.

    size (int or Sequence[int]): The largest padded size to batch sequences into.
        Can be a single integer, or a sequence, allowing for variable batch sizes.
    buffer (int): The number of sequences to accumulate before sorting by length.
        A larger buffer will result in more even sizing, but if the buffer is
        very large, the iteration order will be less random, which can result
        in suboptimal training.
    discard_oversize (bool): Whether to discard sequences that are by themselves
        longer than the largest padded batch size.
    get_length (Callable or None): Function to get the length of a sequence item.
        The `len` function is used by default.
    r)rrr)rÚminibatch_by_padded_size)rrrrÚ	optionalss     úXC:\Users\garci\AppData\Roaming\Python\Python312\site-packages\spacy/training/batchers.pyÚ"configure_minibatch_by_padded_sizers=€ð2/9Ð.D�˜zÑ*È"€IÜÜ ðà
ØØ)ñ	ð
ñðózspacy.batch_by_words.v1Ú	tolerancecó:—|�d
|i
n
i}t
tf
||
|dœ|¤
Ž
S)aCreate a batcher that uses the "minibatch by words" strategy.

    size (int or Sequence[int]): The target number of words per batch.
        Can be a single integer, or a sequence, allowing for variable batch sizes.
    tolerance (float): What percentage of the size to allow batches to exceed.
    discard_oversize (bool): Whether to discard sequences that by themselves
        exceed the tolerated size.
    get_length (Callable or None): Function to get the length of a sequence
        item. The `len` function is used by default.
    r)rrr)rÚminibatch_by_words)rrrrrs     rÚconfigure_minibatch_by_wordsr9s=€ð$/9Ð.D�˜zÑ*È"€IÜÜðà
ØØ)ñ	ð
ñðrzspacy.batch_by_sequence.v1có6—|
�d
|
i
n
i}t
tf
d|i
|¤
Ž
S)zÜCreate a batcher that creates batches of the specified size.

    size (int or Sequence[int]): The target number of items per batch.
        Can be a single integer, or a sequence, allowing for variable batch sizes.
    rr)rr)rrrs   rÚconfigure_minibatchr!Us*€ð/9Ð.D�˜zÑ*È"€IÜ”9Ñ5 4Ð5¨9Ñ5Ð5ré
FÚseqsc#ód
K
—t
|
t«rtj|
«
}nt	|
«
}t||¬
«D]f}t
|«
}t|«
}t|||«D]>}|D�	cgc]}	||	‘Œ	}
}	td„|
D««
t|
«
z}|r||k\r
Œ;|
–
—

Œ@Œhyc
c}	w­w
)aqMinibatch a sequence by the size of padded batches that would result,
    with sequences binned by length within a window.

    The padded size is defined as the maximum length of sequences within the
    batch multiplied by the number of sequences in the batch.

    size (int or Sequence[int]): The largest padded size to batch sequences into.
    buffer (int): The number of sequences to accumulate before sorting by length.
        A larger buffer will result in more even sizing, but if the buffer is
        very large, the iteration order will be less random, which can result
        in suboptimal training.
    discard_oversize (bool): Whether to discard sequences that are by themselves
        longer than the largest padded batch size.
    get_length (Callable or None): Function to get the length of a sequence item.
        The `len` function is used by default.
    )
rc
3ó2K
—|]}
t
|
«
–
—

Œy­w
©
N©
Úlen)Ú.0Úseqs  rú	<genexpr>z+minibatch_by_padded_size.<locals>.<genexpr>‚sèø€Ð;±(¨3œc #Ÿh±(ùó‚
N)Ú
isinstanceÚintÚ	itertoolsÚrepeatÚiterrÚlistÚnextÚ_batch_by_lengthÚmaxr()r#rrrrÚsize_Úouter_batchÚtarget_sizeÚindicesÚ
iÚsubbatchÚpadded_sizes            rrrbs«èø€ô.�$œÔÜ× Ñ  Ó&‰ä�T“
ˆÜ  ¨F×3ˆÜ˜;Ó'ˆÜ˜5“kˆÜ'¨°[À*ÖMˆGÙ07Ó8±¨1˜ A›°ˆHÐ8ÜÑ;±(Ó;Ó;¼cÀ(»mÑKˆKÙ K°;Ò$>Øà“ñ
N
ñ4ùò9ùs‚A,B0
Á.B+Á:6B0
gš™™™™™É?c#ó”K
—t
|
t«rtj|
«
}nt	|
«
}t|«
}||z}g}g}	d
}
d
}|D]Þ}||«
}
|
||zkDr	|r
Œ|g
–
—

Œ|d
k(r|
|
z|kr|j
|«

|
|
z
}
Œ@|
|z|
z||zkr|	j
|«

||
z
}Œe|r|–
—

t|«
}||z}|	}|}
g}	d
}|
|
z|kr|j
|«

|
|
z
}
΢|
|
z||zkr|	j
|«

||
z
}ŒÄ|r|–
—

t|«
}||z}|g
}|
}
Œà|j|	«

|r|–
—

yy­w
)aêCreate minibatches of roughly a given number of words. If any examples
    are longer than the specified batch length, they will appear in a batch by
    themselves, or be discarded if discard_oversize=True.

    seqs (Iterable[Sequence]): The sequences to minibatch.
    size (int or Sequence[int]): The target number of words per batch.
        Can be a single integer, or a sequence, allowing for variable batch sizes.
    tolerance (float): What percentage of the size to allow batches to exceed.