-:jR$v dZddlmZddlZddlmZddlmZmZm Z m Z ddl m Z dd l mZmZmZmZdd lmZdd lmZmZdd lmZmZej4eZed Zej=dgd d{deeej@dfdee!ejDddfdee dzejDddfdee!ejDddfdeddf dZ#d ede!fd!Z$ej=d"gd# d|d eedzej@d$fd%ee!ejDd&d'd(fd)ee!ejDd*d+fd,ee!ejDd-d.d/fd0ededdfd1Z%d2edzd0edzd%e!d)e!d,e!dedzddfd3Z&d ed%e!d)e!d,e!dedzddf d4Z'ej=d5d6d7g d}deeej@d8fdeddfd9Z(ej=d:gd; d~deeej@d8fdd?fd@ee!ejDdAdBfdeddf dCZ)ej=dDgdE dd eeej@dFfd,ee!ejDd-d.dGfdd?fdHee!ejDdIdJfdKee*edzejDdLfdMee*edzejDdNfdeddfdOZ+ej=dPgdQ d}dReeej@dSfdTeeej@dUfdeddfdVZ,ej=dWgdX ddYeedzej@dZfd[eedzej@d\fd:ee!ejDd]fd^ee!ejDd_d`fdaee!ejDdbdcfddeedzejDdefdfeedzejDdgfdHee!ejDdIdhfdKee*edzejDdifdMee*edzejDdjfdkeedzejDdlfdmee!ejDdndofdpee!ejDdqdrfdsee!ejDdtdudvfdeddf dwZ-ej=dxgdyedzy)z7Contains commands to interact with buckets via the CLI.) AnnotatedN)logging) BUCKET_PREFIX BucketFile FilterMatcher_parse_bucket_uri) REPO_REGIONS) SearchOptTokenOpt get_hf_api typer_factory)make_cp) format_sizeprint_file_listing) OutputFormatoutz"Commands to interact with buckets.)helpcreate)zhf buckets create my-bucketz hf buckets create user/my-bucketz-hf buckets create hf://buckets/user/my-bucketz*hf buckets create user/my-bucket --privatez+hf buckets create user/my-bucket --exist-okz,hf buckets create user/my-bucket --region us)nameexamples bucket_idzTBucket ID: bucket_name, namespace/bucket_name, or hf://buckets/namespace/bucket_nameprivatez --privatezCreate a private bucket.regionz--regionzdCloud region in which to create the bucket. Can be one of 'us' or 'eu'. Requires Team plan or above.exist_okz --exist-okz3Do not raise an error if the bucket already exists.tokenreturncrt|}|jtrCt|}|jr t j d|dtd|j}|j||r|nd||}tjd|jj|jy) zCreate a new bucket.rz-Cannot specify a prefix for bucket creation: . Use namespace/bucket_name or namespace/bucket_name.N)rrrzBucket created)uriurl)r startswithrr path_in_repotyper BadParameterid create_bucketrresultr#to_urir$)rrrrrapiparsed bucket_urls ]/var/www/html/tokenscope/api/venv/lib/python3.12/site-packages/huggingface_hub/cli/buckets.pyrr.sT 5 !CM*"9-   $$? {K11>?UW II """ #J JJZ^^%:%:%<*..Qargumentcd|jtr|ttd}d|vS|}d|vS)zFCheck if argument is a bucket ID (namespace/name) vs just a namespace.N/)r%rlen)r2paths r0 _is_bucket_idr7ls?=)M*,- $; $;r1z list | ls) zhf buckets listzhf buckets list huggingfacez$hf buckets list --search "my-prefix"zhf buckets list user/my-bucketz!hf buckets list user/my-bucket -Rz!hf buckets list user/my-bucket -hz%hf buckets list user/my-bucket --treez(hf buckets list user/my-bucket --tree -hz+hf buckets list hf://buckets/user/my-bucketz%hf buckets list user/my-bucket/sub -RzyNamespace (user or org) to list buckets, or bucket ID (namespace/bucket_name(/prefix) or hf://buckets/...) to list files.human_readablez--human-readablez-hz$Show sizes in human readable format.as_treez--treez3List files in tree format (only for listing files). recursivez --recursivez-Rz0List files recursively (only for listing files).searchc|duxr t|}|r(|tjdt|||||yt ||||||y)zList buckets or files in a bucket. When called with no argument or a namespace, lists buckets. When called with a bucket ID (namespace/bucket_name), lists files in the bucket. Nz'Cannot use --search when listing files.)r2r8r9r:r) namespacer;r8r9r:r)r7r'r( _list_files _list_buckets)r2r8r9r:r;r is_file_modes r0list_cmdrAusgr4'CM(,CL  $$%NO O)   )  r1r=c |rtjd|rtjd|8|jtr#|t td}|j d}t |}|j||Dcgc]T}|j|j|rt|j|n |j|j|jdV}}tj|dd i ycc}w) zList buckets in a namespace.z'Cannot use --tree when listing buckets.z,Cannot use --recursive when listing buckets.Nr4r )r=r;)r)rsize total_files created_atrCright) alignments)r'r(r%rr5rstripr list_bucketsr)rrrCrDrErtable) r=r;r8r9r:rr-bucketitemss r0r?r?s  !JKK  !OPP!5!5m!Dc-023 $$S) 5 !C&&6&J   ))~~@NK ^r>s388|000  !HII 5 !C x (F   II&&.$   Eu^WXabr1infozhf buckets info user/my-bucketz+hf buckets info hf://buckets/user/my-bucketzFBucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}t|}|j|j}t j |dy)zGet info about a bucket.r r))id_keyN)rr bucket_infor)rdict)rrr-r.rKs r0rTrTs8" 5 !C y )F __VYY 'FHHVD!r1delete)z hf buckets delete user/my-bucketz-hf buckets delete hf://buckets/user/my-bucketz&hf buckets delete user/my-bucket --yesz-hf buckets delete user/my-bucket --missing-okyesz--yesz-yzSkip confirmation prompt. missing_okz --missing-okz3Do not raise an error if the bucket does not exist.c|jtrDt|}|jr t j d|dtd|j }n$d|vr t j d|dtdtjd|d| t| }|j|| tjd | y)zDelete a bucket. This deletes the entire bucket and all its contents. Use `hf buckets rm` to remove individual files. z-Cannot specify a prefix for bucket deletion: r!r"r4zInvalid bucket ID: z-. Must be in format namespace/bucket_name or z(Are you sure you want to delete bucket ''?rZr )r[zBucket deleted)rN) r%rrr&r'r(r)rconfirmr delete_bucketr+)rrZr[rr.r-s r0rYrYsJM*"9-   $$? {K11>?UW II I   !)-;;H/I_ a  KK:9+RHcR 5 !CiJ7JJ95r1z remove | rm)z)hf buckets remove user/my-bucket/file.txtz2hf buckets rm hf://buckets/user/my-bucket/file.txtz.hf buckets rm user/my-bucket/logs/ --recursivez:hf buckets rm user/my-bucket --recursive --include "*.tmp"z8hf buckets rm user/my-bucket/data/ --recursive --dry-runzBucket path: namespace/bucket_name/path or hf://buckets/namespace/bucket_name/path. With --recursive, namespace/bucket_name is also accepted to target all files.z0Remove files recursively under the given prefix.dry_runz --dry-runz8Preview what would be deleted without actually deleting.includezQInclude only files matching pattern (can specify multiple). Requires --recursive.excludezLExclude files matching pattern (can specify multiple). Requires --recursive.c:t|}|j|j}|dk(r|stjddd|s|r|stjdt |} |rt jd} g} | j|xsdd D]B} t| ts| j| | jd t| d D| jd t| d |s|r9t|| } | Dcgc] }| j!|j"s|"}}n| }|Dcgc]}|j"}}t%d|D}t'|d }|st j(dyt|d|}|sK|sIt j(dj+d|Dt j,d|ddd|rGt j(dj+fd|Dt j(d|dy| j/|t j0d|ddt||y|}|stjd |r7t j(d!t2d"|t j(d#yt j,d$|d%d|| j/|gt j0d&|'ycc}wcc}w)(zbRemove files from a bucket. To delete an entire bucket, use `hf buckets delete` instead. z?No file path specified. To remove files, provide a path (e.g. 'zd/FILE') or use --recursive to remove all files. To delete the entire bucket, use `hf buckets delete z`.z,--include and --exclude require --recursive.r zListing files from remoteNTrNzListing files from remote (z files))include_patternsexclude_patternsc34K|]}|jywN)rC).0fs r0 zremove..s7A7s)r8zNo files to remove.z file(s) totaling  c3&K|] }d| yw)z N)rjr6s r0rlzremove..sBtD6{BszRemove z from 'r]Fr^c3:K|]}dtd|yw)delete: r4N)r)rjr6rs r0rlzremove..s#cPT- 1TFKcsz (dry run) z would be removed.)rYzRemoved ')r files_deletedrCzFile path cannot be empty.rqr4z"(dry run) 1 file would be removed.zRemove 'z' from 'z File removed)r6r)rr)r&r'r(rrstatusrS isinstancerappendupdater5donermatchesr6sumrtextjoinr_batch_bucket_filesr+r)r2r:rZrarbrcrr.rOr-rt all_filesitemmatcherrk matched_files file_paths total_sizesize_str count_label file_pathrs @r0removerQszx (F I  F |I   k"DDM;b R  7I  !OPP 5 !C78&( (( >T)  UD $ +  & ;C N;K7ST U  1#i.1AIJ g#WwWG(1M1W__QVV5LQMMM%M&34aff4 4777 z$? HH* + Z));H:F 7 HHTYYBzBB C KK'+gi[C O  HHTYYcXbcc d HHz+.@A B  y< {m79+Q 7j/   $$%AB B  HHx yk9+F G HH9 :  hyk)B?SI y)= > YGYN5s L:LLmove)z/hf buckets move user/old-bucket user/new-bucketz/hf buckets move user/my-bucket my-org/my-bucketzIhf buckets move hf://buckets/user/old-bucket hf://buckets/user/new-bucketfrom_idzMSource bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_nameto_idzRDestination bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}|jr tjd|dtdt|}|jr tjd|dtdt |}|j |j|jtjd|j|jy)z2Move (rename) a bucket to a new name or namespace.z)Cannot specify a prefix for bucket move: r!r"r )rrz Bucket movedN) rr&r'r(rr move_bucketr)rr+)rrr parsed_from parsed_tor-s r0rrs2$G,K  7yA--:O;Q S  "%(I  7w?--:O;Q S  5 !COOKNN),,O?JJ~{~~Y\\Jr1sync)z2hf buckets sync ./data hf://buckets/user/my-bucketz2hf buckets sync hf://buckets/user/my-bucket ./dataz;hf buckets sync ./data hf://buckets/user/my-bucket --deletez^hf buckets sync hf://buckets/user/my-bucket ./data --include "*.safetensors" --exclude "*.tmp"zIhf buckets sync ./data hf://buckets/user/my-bucket --plan sync-plan.jsonlz'hf buckets sync --apply sync-plan.jsonlzrTrYrRrrrror1r0rs > #" :&   H %!EF    0   90R g  0R  +  0R t w   0R*  F  +0R8 90R: ;0R 0RfCD   0    E>  d W  >    7  > $  F  %> 2   C  3> B C> D E> F G> > B 3Tz 3 $J 3 3 3  3 : 3  3Fcccc c : c  c0  (5 " Y   "  "  " "   .  -.6 Y  .6    ,   .6  F  .6, -.6. /.6.6b   6    [H a  H   C  H$    ,   %H4  K  5HB S D d  CHN S D _  OHZ [H\ ]H HD  *"K  `  "K  e   "K "K "K"KT    &         yrP  d ^   rP  d c   rP   B   rP&  N  'rP4  O  5rPB  d  P   CrPN  d  6   OrPZ  H  [rPh S D I  irPt S D I  urP@ d  ;  ArPL  T  MrPZ  V  [rPh   8  irPx yrPz {rP rPv    )r1