Why Gemfury?
Push, build, and install
RubyGems
npm packages
Python packages
Maven artifacts
PHP packages
Go Modules
Debian packages
RPM packages
NuGet packages
Repository URL to install this package:
|
Version:
6.0.24-6.0 ▾
|
python3-s3fuse-plugin-el9
/
usr
/
lib
/
python3.9
/
site-packages
/
s3fuse
/
__pycache__
/
vaults3.cpython-39.pyc
|
|---|
a
]rg¼ ã @ s d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl m
Z
ddl m Z dZ
dZdZdZe e¡Zd d
ZG d d d eZdS )
z Trilio S3 Backend implimentation
This module contains the back end implimentation of all of all S3 specific
support.
é N)Ú ClientError)Úget_retention_modeÚs3iè z$80bc80ff-0c51-4534-86a2-ec5e719643c2iô c C s& | j dd}|t ddd¡ ¡ }|S )zè Utility function used to convert a datetime to an OS timestamp.
Args:
modified_time (datetime): Datatime object to convert to a Unix Epoc timestamp.
Returns:
The value of modified_time as a timestamp.
N)Ztzinfoi² é )ÚreplaceÚdatetimeZ
total_seconds)Z
modified_timeZ
naive_timeZ
delta_seconds© r ú2/usr/lib/python3.9/site-packages/s3fuse/vaults3.pyÚ_make_timestamp# s ÿr
c @ sö e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd d
Z dd Z
d<ddZ dd Z dd Z
dd Zdd Zdd Zd=d d Zd!d" Zd>d#d$Zd?d%d&Zd@d'd(Zd)d* Zd+d, Zd-d. Zd/d0 Zd1d2 ZdAd4d5ZdBd6d7Z d8d9 Z d:d; Z d S )CÚ S3Backendz´ S3 Backend implimentation.
A Wrapper for the AWS S3 boto3 and botocore API. This class encapsulates all S3
operations and exposes them as a backend storage instance.
c
C sd d }d }|| _ | d¡r&t| d¡nt}|d dkrVtjj|d t|d |d}ntjjt|d |d}|d s²tjd|d d
|d |d |d d
||d |d d}n||d dkrútjd|d d
|d |d |d d
||d |d d}n4tjd|d d
|d |d |d d
||d d}dd }|jj
d|¡ || _ |d | _ |d | _
d S )NZ vault_s3_max_pool_connectionsZ s3_signatureÚdefaultZs3_read_timeout)Zsignature_versionÚ read_timeoutÚmax_pool_connections)r
r Z
s3_ssl_verifyr Z
os_optionsÚ region_nameÚuserÚkeyZobject_storage_urlZs3_ssl)r Úaws_access_key_idÚaws_secret_access_keyÚ endpoint_urlÚconfigÚuse_sslZverifyZ s3_ssl_certÚ )r r r r r r c [ s d| j d< d S )Nz
keep-aliveZ
Connection)Úheaders)ZrequestZoperation_nameÚkwargsr r r Úset_connection_header] s z1S3Backend.__init__.<locals>.set_connection_headerzrequest-created.s3ÚbucketÚretention_mode)ÚoptionsÚgetÚintÚDEFAULT_MAX_POOL_SIZEÚbotocoreZclientZConfigÚboto3ÚmetaZeventsÚregisterÚ_S3Backend__clientÚ_S3Backend__bucket_nameÚ_S3Backend__retention_mode)Úselfr Z
config_objectZ s3_clientZ
MAX_POOL_SIZEr r r r Ú__init__9 sX ÿÿ
þÿ
û
û
û
zS3Backend.__init__c C s( t | j|d |d |d< |d | _d S )Nr Úbucket_object_lockr )r r% r' )r( r r r r Úset_retention_modee s z S3Backend.set_retention_modec
C s" z | j j| jd z| j j| jd}|d rP| di ¡ d¡dkrPtd| |d sz| di ¡ d¡dkrztd| |d r|d std W n. ty } z|d r® W Y d
}~n
d
}~0 0 |d s tj d d d
dddd¡}| j j | j|dd | j j
| j|d W n Y n0 d
S )af Validates the S3 credentials / permission on the provided bucket.
It also validates against s3 object lock configuration and if the s3 supports
more than 255 object name length
Args:
self : S3 Backend object
Returns:
Does not return anything, But raises exception if validation fails.
)ÚBucketr* ZObjectLockConfigurationZObjectLockEnabledZEnabledzZConfigration says object lock enabled on the bucket, but s3 API does not agree with it. %sz[Configration says object lock disabled on the bucket, but s3 API does not agree with it. %sÚuse_manifest_suffixzR'use_manifest_suffix' must be set to True when 'bucket_object_lock' is set to TrueNztvault_config/z.workload_f5190be6-7f80-4856-8c24-149cb40500c5/z.snapshot_f2e5c6a7-3c21-4b7f-969c-915bb408c64f/z+vm_id_e81d1ac8-b49a-4ccf-9d92-5f1ef358f1be/z3vm_res_id_72477d99-c475-4a5d-90ae-2560f5f3b319_vda/z.deac2b8a-dca9-4415-adc1-f3c6598204ed-segments/z0000000000000000.00000000z Test Data)r, ÚKeyÚBody©r, r. ) r% Z head_bucketr& Z get_object_lock_configurationr Ú ExceptionÚosÚpathÚjoinÚ
put_objectÚ
delete_object)r( r Z obj_lock_cfgÚexZlong_keyr r r Úvalidate_s3_clientj sL ÿÿÿÿ
ùÿz S3Backend.validate_s3_clientc C s¾ z¤t |dkr¢g }|dt
}|D ](}| d¡r<|dd
}| d|i¡ q"z| jj| jd|id W n, |D ]}| jj| j|d d qrY n0 |td
}qW n ty¸ Y n0 dS ) zß Utility method that takes a list of objects and puts it in the correct format
for the S3 delete_objects() API.
Args:
object_list (list): A list of objects with the correct S3 path.
r Nú/r r. ÚObjects©r, ZDeleter0 ) ÚlenÚMAX_S3_PAGE_SIZEÚ
startswithÚappendr% Údelete_objectsr& r6 r )r( Ú object_listZobject_delete_listZ list_partÚobjr r r Z__delete_object_list s(
ÿ
ÿ z S3Backend.__delete_object_listc C s ztg }| j d¡}|j| j|d}|D ]@}d|v r&| dt|d ¡dkr&|d D ]}| |d ¡ qRq&| |¡ W n ty Y n0 dS )z Utility method used to perform a rmdir operation on an object hierarchy
Args:
object_tree (str): Object/Tree path.
Ú list_objects©r, ÚPrefixÚContentsÚKeyCountr r. N) r% Ú
get_paginatorÚpaginater& r r< r? Ú _S3Backend__delete_object_listr )r( Ú object_treerA Úlist_paginatorÚ
page_iteratorÚobjectsrB r r r Z__delete_object_treeº s ÿ z S3Backend.__delete_object_treec C s | |¡ dS )zó Delete a list of objects.
Args:
object_list (list): List of objects. Each with a full object path
in correct format.
options (dic): Dictionary of configuration options.
N)rJ )r( rA r r r r Údelete_object_listÐ s z S3Backend.delete_object_listc C s¬ z|s W dS d |¡}| d¡r,|dd
}d|v rH| jj| j|d nH| d¡d }| j|dd}|rzt|dd d
}n|}| jj| j|d W n ty¦ Y n0 dS ) a Delete an object from the S3 object store.
The object and any segments stored in the segment directory will be
removed.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
Nr9 r ú -segmentsr0 ú .manifestT©Ústrict_path_filter©Úreverser ) r4 r> r% r6 r& ÚstriprC Úsortedr )r( Úargsr Ú object_nameÚmanifest_prefixÚ manifestsÚ
manifest_namer r r r6 Ú s(
ÿ
ÿ
zS3Backend.delete_objectr c C s° t d|}ztd|D ]|}z | jj| j|d W W dS ty } zB|jd d dkrz|d |krzt d¡ W Y d}~q W Y d}~qd}~0 0 qW n tyª Y n0 dS )a Utility method used to wait for a S3 object to become available.
This routine will keep performing a head_object() request every second
for "retries" number of times. This was added to work around any potential
eventual consistancey issues when uploading to AWS.
Args:
object_name (str): Name of the object.
retries (int): Optional parameter that defaults to 1.
Returns:
Returns when the object is available or ClientError not found exception.
r r r0 NÚResponseMetadataÚHTTPStatusCodeé ) ÚmaxÚranger% Ú head_objectr& r ÚresponseÚtimeÚsleep)r( rY ÚretriesÚretryÚerrorr r r Z__wait_for_objectý s"
ÿ
ÿ
zS3Backend.__wait_for_objectc C s zb| d¡d }| jd r(| jd r<| jj| j|d}n| jj| j|d}|r,|}| dg ¡pn| dg ¡}| jd r| jj| j|d}| dg ¡p¤| dg ¡}|rºt|dd d
}|D ]Z}| jj | j|d | d d
¡d}|d d dd¡dkr¾t
|d |d ¡¡ W S q¾|d d }n|}|s:t
d| jj | j|d}t
|d |d ¡¡W S tyþ } z|jd d dkr n\zD| |d¡ | jj | j|d}t
|d |d ¡¡W W Y d }~S tyè Y n0 W Y d }~n
d }~0 0 d S ) úÓ Download and return the object manifest as a json array.
Args:
object_name (str): Name of the object.
Returns:
Object manifest as a dictionary.
r9 rQ r- r* rD ÚVersionsrF c S s | d S ©NÚ LastModifiedr ©Úkr r r Ú<lambda>8 ó z/S3Backend.get_object_manifest.<locals>.<lambda>©r r. Ú VersionIdr ©r, r. rr r] Ú HTTPHeadersú$x-amz-meta-stamp-trilio-authenticityÚFalseÚTruer/ Ú
ContentLengthéÿÿÿÿzOManifest object with 'x-amz-meta-stamp-trilio-authenticity' attribute not foundr0 r^ r_ é
N)rV r r% Zlist_objects_v2r& rC r Úlist_object_versionsrW Ú
get_objectÚjsonÚloadsÚreadr1 r rc Ú_S3Backend__wait_for_object) r( rY rZ r[ r\ Úmanifests_dataÚmanifestÚresprh r r r Úget_object_manifest sd
þþ
þ ÿÿ ÿ
ÿ&z S3Backend.get_object_manifestc C sÈ | d¡d }| jd r dS | jj| j|d}|r¸| dg ¡pH| dg ¡}g }|D ]}| d|d i¡ qR|rÄz| jj| jd |id
W qÄ |D ]}| jj| j|d d qY qÄ0 n t d | dS )
ri r9 rQ r* NrD rj rF r. r: r; r0 z Manifest for %s is not found)
rV r r% rC r& r r? r@ r6 r1 )r( rY rZ r r[ Úobjs_to_deleteÚmanrB r r r Údelete_object_manifestX s.
þ
ÿ
ÿz S3Backend.delete_object_manifestc C sd z8d |¡}i }|jr d|ji}| j | j||j|¡ W n& tyL Y n ty^ Y n0 dS )a? Download a file from the S3 object store.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
Returns:
On success, the contents of the object are downloaded to file identidfied
by options.out_file.
r9 rr N)r4 Ú
version_idr% Z
download_filer& Zout_filer r1 )r( rX r rY Ú
extra_argsr r r Údownload_objectz s
ÿ zS3Backend.download_objectc C st zHd |¡}|jr*| jj| j||jd}n| jj| j|d}|d ¡ W S ty\ Y n tyn Y n0 dS )aB Get object from the S3 object store in buffer.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
Returns:
On success, the contents of the object are downloaded to file identidfied
by options.out_file.
r9 rs r0 r/ N)r4 r r% r| r& r r r1 )r( rX r rY rc r r r r| s"
ýþ zS3Backend.get_objectc C s zj|j du r0| tj |d d |d ¡|¡ |jdurh| jj| j|d d |d ||dd}|W S W n t y~ Y n0 dS )a Put an object to the S3 object store.
Args:
args (list): List of object name parts.
buf: Data to upload in object.
buf_len: Length of data to upload in object.
options (dic): Dictionary of configuration options.
Fr r9 rY Núapplication/octet-stream)r, r. rx r/ Ú ContentType)
Ú
path_validÚ_S3Backend__create_folderr2 r3 ÚdirnamerY r% r5 r& r )r( rX ÚbufZbuf_lenr r r r r r5 ¬ s
ÿ
ü
zS3Backend.put_objectNFc C s^ t }| d¡}z0t}|dur,|tk r,|}| jd rD| j d¡}n | j d¡}|j| j|dd|id}|D ]Ê}d|v r| d t |d ¡d
kr|d D ]f} |durÈt ||krÈt
| W S | d d¡}
|ræ| |
¡ qd |
v r| |
d d
¡d
¡ qd|v r¤| d t |d ¡d
kr¤|d D ]p} |dur`t ||kr`t
| W S | d d¡}
|r| |
¡ n d |
v r2| |
d d
¡d
¡ q2d|v rl|d D ]} |durât ||krât
| W S | t¡sþ| d t¡s´| d¡r | | d d¡¡ n| | d d¡¡ q´qlt
|W S tyX Y n0 dS )ae Return a list of objects based on the provided prefix.
Used to generate a directory listing based on a prefix path
constructed from the object parts in prefix
Args:
prefix (string): prefix of the object path. If the prefix is terminated
by "/", then it lists the contents in the "subdir". If the prefix
is not terminated by "/", then it lists the contents in the current
directory that matches the prefix
Ex:
case 1:
=======
prefix - /a/b/c
object store has objects - /a/b/c, /a/b/c1, /a/b/d
return values - /a/b/c and /a/b/c1
case 2:
=======
prefix - /a/b/c/
object store has objects - /a/b/c/d, /a/b/c1, /a/b/c/e
return values - /a/b/c/d and /a/b/c/e
options (dic): Dictionary of configuration options
max_items (int): Maximum number of objects in a list query. Default is
unlimited but when testing for an empty directory a smaller
number can be used to limit the query and size of the list that
is returned.
strict_path_filter (bool): Defaults to True in order to only return
objects with the exact same prefix. Individual segment listings
set this to False in order to get a match on the segment offset.
Returns:
On success a list of unique items to be used as a directory listing.
r9 Nr* r{ rC ZPageSize)r, rE Ú DelimiterZPaginationConfigrF rG r r. rQ r rj ÚCommonPrefixesrE )ÚsetÚlstripr= r r% rH rI r& r r< ÚlistÚrstripÚaddÚsplitr> Ú_SEGMENT_PREFIXÚendswithrV r ) r( ÚprefixZ max_itemsrS Z
object_setZ page_sizerL rM rN ÚitemrY Z
object_prefixr r r rC È s\ #
ý
$ $
ÿ
zS3Backend.list_objectsc C sH z.g }t j d |¡|j¡}| j|dd}|W S tyB Y n0 dS )a& Returns a list of object segments based on a prefix.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
Returns:
A list of segments in the object store that match the supplied prefix.
r9 TrR N)r2 r3 r4 r rC r )r( rX r Z segment_listZ
segments_pathrA r r r Ú
list_segments, s
ÿ zS3Backend.list_segmentsc C sZ g }| j d¡}|j||dD ]}d|v r | |d ¡ q t|dd dd}dd |D S )
a+
List all object versions in a bucket sorted from latest to oldest.
:param bucket_name: Name of the S3 bucket
:param prefix: (Optional) Filter objects starting with this prefix
:return: List of object versions sorted by last modified date (latest to oldest)
r{ rD rj c S s | d S rk r )Úvr r r ro R rp z7S3Backend.list_sorted_object_versions.<locals>.<lambda>T©r rU c S s> g | ]6}|d |d |d |d | dd¡| dd¡dqS ) r. rr rl ÚIsLatestÚSizer ÚETagr )r. rr rl r r¡ r¢ )r )Ú.0Úversionr r r Ú
<listcomp>U s ù
úz9S3Backend.list_sorted_object_versions.<locals>.<listcomp>)r% rH rI ÚextendrW )r( Ú bucket_namer ZversionsZ paginatorZpageZsorted_versionsr r r Úlist_sorted_object_versionsA s ÷z%S3Backend.list_sorted_object_versionsc C s | ||¡S )N)Ú _S3Backend__get_object_headers)r( rY rf r r r Úget_object_headersa s z S3Backend.get_object_headersc C s t d|}zvtd|D ]d}z | jj| j|d}|W W S ty| } z$|jd d dkrfz@| jj| j|d d}| d¡pd |d< |W W Y d
}~ W S tyd } z¤|jd d dkrNd |vr zÒ| d¡d }| j d
r| j
| j|d}|rÔt |dd dd}d
}|D ]} | jj| j| d | dd¡d}| d |d< | d¡rjt
|¡}|d d dd¡dkr$| W W Y d
}~W Y d
}~ W S q$|W W Y d
}~W Y d
}~ W S |}
| jj| j|d}||d< |W W Y d
}~W Y d
}~ W S | jj| j|d } | d g ¡p@| d g ¡} t | d d d } | rf| d! d }
n|}
| jj| j|
d}|
|d< |W W Y d
}~W Y d
}~ W S W nt ty } zZ|jd d dkr|d |krt d¡ W Y d
}~W Y d
}~W Y d
}~q W Y d
}~n
d
}~0 0 |d |krNt d¡ W Y d
}~W Y d
}~q W Y d
}~n
d
}~0 0 W Y d
}~qd
}~0 0 qW n ty Y n0 d
S )"a= Utility method that gets an object head from the repository with retry support.
The default is to try once. Admittedly, this is ugly because the
provided object name might be a terminal object or a "directory" so
we need to try both cases for each retry attempt. When retry > 1, there is
a 1 second delay between attempts.
Args:
object_name (str): Name of the object.
retries (int): Optional parameter, default is 1 attempt.
Returns:
Object head dictionary or Boto3 exception.
r r r0 r] r^ r_ r9 r úapplication/x-directoryNrP rQ r* )r§ r c S s | d S rk r rm r r r ro rp z0S3Backend.__get_object_headers.<locals>.<lambda>Tr r. rr r rs r rt ru rv rw rD rj rF c S s | d S rk r rm r r r ro § rp rq ry )r` ra r% rb r& r rc r rV r r¨ rW ÚcopyÚdeepcopyrC rd re ) r( rY rf rg Ú obj_headersrh rZ r Zlatest_object_headerr r\ r[ r r r Z__get_object_headersd s®
ÿ
ÿ
ÿ
þ
ÿÿ,$þ$þÿþ(ÿþþ
ý
z S3Backend.__get_object_headersc
C s ddddd}i |d< i |d d< d |¡}zÔ|sLttj ¡ |d< |W S z| |¡}W n tyâ } zp| jj| jd|d }d
|v rÌ|d d d |d
D v rÈtj |d
d d d¡}d|i d}q n W Y d}~n
d}~0 0 t|d |d< ||d< |
dd¡dks |d dkr$d|d< |d d ¡ D ]D\} }
d| ¡ v rf|
|d | ¡
d¡d < n|
|d | ¡ < q4t|d d
d d¡dkr²|d d
d d¡|d < n<t|d
d d¡dkrâ|d
d d¡|d < n |d |d < |d |d!< |W S W n ty Y n0 dS )"a) Get "operating system like" stat data for the given object.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
Returns:
A stat structure containing object information required by caller.
r r F)Ú timestampÚsizeÚetagÚ directoryr ÚMetadatar9 r¯ )r, r rE r c S s g | ] }|d qS )rE r )r£ Úxr r r r¥ Þ rp z)S3Backend.stat_object.<locals>.<listcomp>r] rt Údatez%a, %d %b %Y %H:%M:%S %Z)rx rl r³ Nrl r ú
text/plainr« rx Tr² zx-object-meta-r zx-object-meta-segment-countzx-object-meta-total-sizer° z
segment-countz
total-sizezx-account-bytes-used)r4 r
r Znowr© Ú
BaseExceptionr% rC r& Ústrptimer ÚitemsÚlowerr r r ) r( rX r Z stat_datarY Z
obj_headerr7 rN Zmdr Úvaluer r r Ú stat_object s
ÿýÿþÿ
ÿ
þÿÿÿÿÿ ÿ
ÿ
zS3Backend.stat_objectc C s d |¡}| ||¡ dS )zÎ Create an object that represents a directory in the object store.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
r9 N)r4 r )r( rX r Z
new_folderr r r Ú mkdir_object s
zS3Backend.mkdir_objectc C s\ d |¡d }| d¡r$|dd
}| |¡ z| jj| j|d W n tyV Y n0 dS )zÎ Remove an object that represents a directory in the object store.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
r9 r Nr0 )r4 r> Ú _S3Backend__delete_object_treer% r6 r& r· )r( rX r rK r r r Ú rmdir_object s
ÿ
zS3Backend.rmdir_objectc
C sb zD| d¡d }| jd rv| j|dd}|r`t|ddd d¡d }t|d
}d |d }nd d }|d | }n|}|D ]"}| d
¡|d< | dd¡|d< q~t |¡} | j j
| j ||| dd | jd rD|rDg }
|D ]} |
d| i¡ qÞz| j j
| j d|
id W n6 tyB |
D ] } | j j| j | d d q Y n0 W n ty\ Y n0 dS )a Upload a new object manifest to the object store.
Args:
object_name (str): Name of the object. A ".manifest" will be added.
put_headers (dic): Dictionary of meta data to be
added to the object.
manifest_data (dic): The manifest data which becomes
the body of file.
r9 rQ r- TrR rT r Ú.ry é ú%08xr r3 Únamer± Úhashr¶ )r, r. r³ r/ r r. r: r; r0 N)rV r rC rW r r Úpopr} Údumpsr% r5 r& r? r@ r· r6 r )
r( rY Z put_headersZ
manifest_datarZ r[ Úsuffixr\ Z segment_datar r
r rB r r r Úupload_object_manifest* sR
ÿ
ü þ
ÿz S3Backend.upload_object_manifestc C s¸ z| d¡d }| jd rp| j|dd}|rZt|ddd d¡d }t|d
}d | }nd d }|d | }n|}tj | j |¡}| j
j | j |||d d
W n t y² Y n0 dS )a
Upload a new object manifest to the object store.
Args:
object_name (str): Name of the object. A ".manifest" will be added.
attributes (dic): The attributes data which becomes
the body of file.
r9 rQ r- TrR rT r rÀ ry rÁ r ZREPLACE)r, r. Z
CopySourcer³ ZMetadataDirectiveN)
rV r rC rW r r r2 r3 r4 r& r% Z copy_objectr )r( rY Z
attributesrZ r[ rÇ r\ Zcopy_srcr r r Úupdate_object_attributes] s.
ÿ
ü
z"S3Backend.update_object_attributesr c C sh zN| d¡}|r0| jj| j||| j|dd n | jj| j|| j|dd W n tyb Y n0 dS )a Upload a new object manifest to the object store.
Args:
object_name (str): Name of the object. A ".manifest" will be added.
put_headers (dic): Dictionary of meta data to be added
to the object.
manifest_data (dic): The manifest data which becomes the
body of file.
r9 ©ZModeZRetainUntilDate©r, r. rr Ú Retention©r, r. rÌ N)rV r% Úput_object_retentionr& r' r )r( rY Ú retainuntilÚ versionIdr r r Ú put_object_segment_retention~ s*
ÿüÿý
z&S3Backend.put_object_segment_retentionc C sÚ zÀ|sz| d¡d }| jd rt| j|dd}|r^t|ddd d¡d }t|d
}d | }nd d }|d | }q~|}n|}|r¢| jj| j||| j |d d
n | jj| j|| j |d d W n t
yÔ Y n0 dS )aK Upload a new object manifest to the object store.
Args:
object_name (str): Name of the object. A ".manifest"
will be added. put_headers (dic): Dictionary of meta data
to be added to the object. manifest_data (dic): The manifest
data which becomes the body of file.
r9 rQ r- TrR rT r rÀ ry rÁ r rÊ rË rÍ N) rV r rC rW r r r% rÎ r& r' r ) r( rY rÏ r. rÐ rZ r[ rÇ r\ r r r Úput_manifest_retention sD
ÿ
ÿüÿý
z S3Backend.put_manifest_retentionc C s< z| j j| j|d W n ty6 } z|jd d dkr"| d¡}d}|D ]Î}|dkrd q"|| d }z| j j| j|d W qR ty } z~|jd d dkrþz| j j| j|ddd W n8 tyü } z |jd d d
krè W Y d }~n
d }~0 0 W Y d }~qRW Y d }~qRd }~0 0 qRW Y d }~n
d }~0 0 d S ) a< Utility method used to create a object directory structure.
The entire path is split and each directory level is created
as an object if it does not exist.
Args:
folder_name (str): The entire folder name.
options (dic): Dictionary of configuration options.
r0 r] r^ r_ r9 r z TrilioVault directory objectr« )r, r. r/ r i N)r% rb r& r rc r r5 )r( Z folder_namer rh Ú
path_partsÚnew_pathÚpartr r r Z__create_folderÌ sP
ÿ
ÿ
ÿþþý
ÿþþzS3Backend.__create_folderc C sâ |dd
}z¼|j du r<| tj |d d |d ¡|¡ |jdurÆt|d db}| jj|| j |d d |d dd id
| jj
| j |d d |d d }|W d W S 1 s¼0 Y W n t yÜ Y n0 dS ) zµ Upload an object to the S3 object store.
Args:
args (list): List of object name parts.
options (dic): Dictionary of configuration options.
r NFr r9 rY Úrbr r )r, r. Z ExtraArgsr0 ) r r r2 r3 r rY Úopenr% Zupload_fileobjr& rb r )r( rX r ÚfilesÚdatar® r r r Ú
upload_objectý s4
þ
ÿÿü
ÿþ( zS3Backend.upload_object)r )NF)N)r )r )r )Nr ) Ú__name__Ú
__module__Ú __qualname__Ú__doc__r) r+ r8 rJ r¾ rO r6 r r r r r| r5 rC r r¨ rª r© r¼ r½ r¿ rÈ rÉ rÑ rÒ r rÚ r r r r r 2 s8 ,2
#
<"
d
^I 3!
.1r )rÞ r rd r} r2 Zloggingr¬ r" r! Zbotocore.exceptionsr Z s3fuse.utilsr ZBASENAMEr= r r Z getLoggerrÛ ZLOGr
Úobjectr r r r r Ú<module> s"