Why Gemfury?
Push, build, and install
RubyGems
npm packages
Python packages
Maven artifacts
PHP packages
Go Modules
Debian packages
RPM packages
NuGet packages
Repository URL to install this package:
|
Version:
6.0.1.dev2-6.0 ▾
|
python3-s3fuse-plugin-el9
/
usr
/
lib
/
python3.9
/
site-packages
/
s3fuse
/
__pycache__
/
s3vaultfuse.cpython-39.opt-1.pyc
|
|---|
a
=+fG ã ' @ sæ d Z ddlZddlZddlZddlZddlZddlZddlmZ ddlZddl Z ddl
Z
ddl Z ddl Z ddl m
Z
ddlmZ zddlmZmZ W n" ey¶ ddlmZmZ Y n0 ddlmZ zddlmZmZmZ W n( ey ddlmZmZmZ Y n0 dd l m Z dd
l m Z zdd l m!Z! W n eyN dd l"m!Z! Y n0 dd l#m$Z% dd
l&m'Z' ddl#m(Z( ddl#m)Z) dZ*dZ+dZ,dZ-e!j.ddddde!j.dddddgZ/e!j0d d d d e!j0d d d!d e!j0d"d d#d e!j0d$dd%d&d'e!j0d(e*d)d*d'e!j0d+d d,d-d.e!j0d/d0d1d2e!j.d3dd4d5e!j0d6d7d8d5g Z1e!j.d9d:d;d5e!j.d<dd=d5e!j.d>dd?d5e!j.d@ddAd5e!j2dBdCdDd5gZ3e!j2dEdFdGd5e!j2dHdIdJd5e!j0dKdLdMd5e!j0dNdOdPd5e!j0dQdRdSd5e!j0dTdUdVd5e!j0dWdXdYd5e!j0dZd[d\d5e!j4d]g d^¢d_d5e!j.d`ddad5e!j.dbddcd5e!j0dddedfd5e!j0dgdedhd5e!j2diddjd5gZ5e!j0dkdldmd5e!j0dndodpe!j0dqdrdod5e!j2dse,dtd5e!j2due-dvd5e!j2dwdxdyd5e!j2dzd{d|d5e!j2d}dd~d5e!j0ddd dd'e!j0dddd5e!j0d
ddd5e!j0dddd5e!j0dddd5e!j0dddd5e!j0dddd5e!j0dddd5e!j.dd:dd5e!j0de' dd5e!j0dddd5e!j0dddd5e!j0dddd5e!j0d dd¡d5e!j0d¢d£d¤d5e!j0d¥d¦d§d5e!j0d¨d©dªd5e!j0d«d¬dd5e!j0d®d¯d°d5e!j.d±dd²d5e!j.d³dd´d5g Z6e!j7Z7e7 8e6¡ e7 9e1¡ e7 9e3¡ e7 9e5¡ e7 9e/¡ z e:ej;dµ Z<e7e<g W n& eyh e7ej=dCd
Y n0 d¶e7 >¡ v sd¶e) ?¡ v rdd·l@mAZA n dd¸l#mBZA e% Ce7¡ZDddCg d¹ddddddddddddddº
d:dddej; Ed»¡ej; Ed¼¡ej; Ed½¡dddd:dddddddddg ddd:ddd:d¾d¾d¾d¾ddd¿&ZFdÀdD ZGd¾ZHdÂZIe J¡ ZKe Le M¡ ¡jNZOdÃZPdÄZQdÅdƄ ZRdÇdȄ ZSdÉdʄ ZTG dËd̄ dÌeUZVG dÍd΄ dÎeVZWG dÏdЄ dÐeUZXG dÑd© d©eZYdÚdÓdԄZZdÕdք Z[d×d Z\e]dÙkrâe\ dS )Ûad Trilio Fuse plugin implimentation
This module is based on the vaultfuse.py module and will eventually
become the new vaultfuse.py module once integration and refactoring
of the existing vaultswift.py is complete.
Currently this module is temporary for the 2.6 release and will be merged
into a new vaultfuse.py for the next release.
é N)Údatetime)ÚThread)Úgetpwnam)ÚQueueÚEmpty)ÚLRUCache)ÚFUSEÚ FuseOSErrorÚ
Operations)Ú ClientError)Úbunchify)Úcfg)Ú
tr_logging)Úget_ssl_cert_path)Úvaults3)Ú
config_parserz%Y-%m-%d %H:%M:%Sz$80bc80ff-0c51-4534-86a2-ec5e719643c2éd é ÚdebugÚdFzUPrint debugging output (set logging level to DEBUG instead of default WARNING level).)ZshortÚdefaultÚhelpÚverboseÚvzWPrint more verbose output (set logging level to INFO instead of default WARNING level).z
log-configÚPATHzßIf this option is specified, the logging configuration file specified is used and overrides any other logging options specified. Please see the Python logging module documentation for details on logging configuration files.)Úmetavarr zlog-config-appendz(Optional) Log Appendzwatch-log-filez(Optional) Watch logz
log-formatZFORMATzÞA logging.Formatter log message format string which may use any of the available logging.LogRecord attributes. This option is deprecated. Please use logging_context_format_string and logging_default_format_string instead.)r r r zlog-date-formatZ DATE_FORMATzCFormat string for %%(asctime)s in log records. Default: %(default)szlog-fileZlogfilezZ(Optional) Name of log file to output to. If no default is set, logging will go to stdout.)r Údeprecated_namer zlog-dirZlogdirz@(Optional) The base directory used for relative --log-file paths)r r z
use-syslogzUse syslog for logging.)r r zsyslog-log-facilityZLOG_USERz$syslog facility to receive log linesZ
use_stderrTz Log output to standard errorZ use_journalz%Enable Systemd native journal supportZ use_eventlogz Log output to Windows Event Log.Zuse_jsonz4Enables JSON formatting in the logs when set to TrueZrate_limit_bursté z Burst limitZlog_rotate_intervalé z0Interval, number of hours, of log rate limiting.Zmax_logfile_counté< z Number of log files to retain.Zlog_rotate_interval_typeZHoursz Units of log rotation intervalZlog_rotation_typeÚintervalztype of log retentionZ logging_context_format_stringzw%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user)s %(tenant)s] %(instance)s%(message)sz2format string to use for log messages with contextZ logging_default_format_stringzV%(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)sz5format string to use for log messages without contextZlogging_debug_format_suffixz$%(funcName)s %(pathname)s:%(lineno)dz0data to append to log format when level is DEBUGZlogging_exception_prefixz?%(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)sz5prefix each line of exception output with this formatZdefault_log_levels)z amqplib=WARNzsqlalchemy=WARNz boto=WARNz suds=INFOz
keystone=INFOzeventlet.wsgi.server=WARNzlist of logger=LEVEL pairsZpublish_errorszpublish error eventsZfatal_deprecationszmake deprecations fatalZinstance_formatz[instance: %(uuid)s] zBIf an instance is passed with the log message, format it like thisZinstance_uuid_formatzGIf an instance UUID is passed with the log message, format it like thisZrate_limit_intervalz2Interval, number of seconds, of log rate limiting.Zvault_storage_typeZs3z'Storage type: nfs, swift-i, swift-s, s3Úvault_data_directoryz'Location where snapshots will be stored)r Úvault_data_directory_oldz/var/triliovaultÚ queue_depthz-The number of writes to be queued (writeback)Úworker_pool_sizez3Number of worker threads to process the write queueZvault_retry_counté z(The number of times we retry on failuresÚvault_segment_sizei z vault object segmentation sizeÚvault_cache_sizez6Number of segments of an object that need to be cachedZ
rootwrap_confz/etc/nova/rootwrap.confzrootwrap config fileZvault_s3_auth_versionZDEFAULTzS3 Authentication typeÚvault_s3_access_key_idÚ z S3 Key IDÚvault_s3_secret_access_keyzS3 Secret Access KeyÚvault_s3_region_namez S3 RegionÚvault_s3_bucketz S3 BucketÚvault_s3_endpoint_urlzS3 Endpoint URLÚ vault_s3_sslÚFalsezEnable SSL certificateÚvault_s3_ssl_verifyz)Whether or not to verify SSL certificatesÚvault_s3_ssl_certzUse SSL certificate bundleÚvault_s3_signature_versionr zS3 signature version to useÚvault_s3_read_timeoutZ30z3Time in seconds to wait for a response to API callsZvault_enable_threadpoolÚTruezEnable backend thread poolÚvault_threaded_filesystemz"Allow multiple file system threadsZmax_uploads_pendingZ20zNumber of file uploads.Zvault_cache_usernameZnovazSystem username.Úvault_storage_nfs_exportÚ TrilioVaultzendpoint/bucket_nameZvault_logging_levelÚerrorz0Logging level filter (debug, info, warn, error).Ú vault_s3_max_pool_connectionsÚ500z>The maximum number of connections to keep in a connection poolÚbucket_object_lockz#S3 bucket object locking is enabledÚuse_manifest_suffixzyTo preserve backward compatibility, set this to False.When set to False, s3fuse creates manifest file nameswithout suffixZFLAGZs3fuse_sys_admin)Úfs)Úutilsú1.0)
Z project_nameÚ region_nameZuser_domain_nameZ
endpoint_typeÚobject_storage_urlZproject_domain_idÚuser_idZuser_domain_idZ tenant_idZ service_typeZ
project_idZ
auth_tokenZproject_domain_nameZ OS_CACERTZOS_CERTZOS_KEYé
)&Zsync_tor ÚheaderÚ auth_versionÚ
os_optionsZssl_compressionZos_storage_urlZ os_usernameZ os_passwordZ os_cacertZos_certZos_keyZos_tenant_nameZ os_auth_urlZ
os_auth_tokenZinsecureZsnetZsync_keyZauthÚuserÚkeyZread_aclÚinfoZretriesZ write_aclÚmetar Zuse_sloZchecksumZchangedÚleave_segmentsZskip_identicalZsegment_threadsZobject_dd_threadsZobject_uu_threadsZcontainer_threadsZyes_allÚ object_namec C s
dt d< tjt d< tjt d< tjt d< tjt d< tjt d< tjt d< tjt d < tj t d
< tj
t d < d t d
< tj t d< dt d< tj rtj t d d< tj
r¤tj
t d d< tj s¶tj t d< nPtj
¡ dkrÞtj tj¡rÞtjt d
< n(tj
¡ dkrt dtj ¡ d t d
< d S )Nr? rE rG rH ZbucketZ s3_signatureZs3_read_timeoutr9 r; r< Zs3_sslr) Z s3_ssl_certZ
s3_ssl_verifyZ
COMPLIANCEZretention_moderF rA r@ ÚtrueZfalsezcInvalid S3 SSL cert file path: %sUsing Default path, set the value to False for insecure connection)ÚoptionsÚCONFr( r* r, r2 r3 r9 r; r< r. r0 r- r+ ÚlowerÚosÚpathÚexistsr1 ÚLOGÚwarn© rV rV ú6/usr/lib/python3.9/site-packages/s3fuse/s3vaultfuse.pyÚ
option_config s@
ÿ
ÿ
ÿ ýÿrX é z
%016x.%08xiè c s t ¡ fdd}|S )Nc sò zt j t j¡ W n" ty4 t j t j j¡ Y n0 z~ | i |¤W zt j t j¡ W S tyz t j t j j¡ Y S 0 S zt j t j¡ W qî ty² t j t j j¡ Y qî0 n8zt j t j¡ W n" tyê t j t j j¡ Y n0 0 d S ©N)ÚloggingÚdisableZERRORÚ
BaseExceptionZNOTSET)ÚargsÚkwargs©ÚfuncrV rW Úwrapper¸ s& û ý z disable_logging.<locals>.wrapper)Ú functoolsÚwraps)ra rb rV r` rW Údisable_logging· s re c C sR t j | ¡\}}d}|dvrJ|dkr4t j ||¡}n|}t j |¡\}}q||fS ©Nr) )r) ú/©rQ rR ÚsplitÚjoin)rR ÚheadÚtailÚprefixrV rV rW Úsplit_head_tailÈ s rn c C s t j | ¡\}}|S rZ ©rQ rR ri )rR rk rl rV rV rW Úget_headÕ s rp c @ s e Zd Zdd Zdd Zdd Zdd Zd d
Zd d Zd
d Z dd Z
d ddZ d ddZ dd Z
dd Zdd Zd d ZdS ) ÚObjectRepositoryc K s
|| _ d S rZ )Úroot©Úselfrr r_ rV rV rW Ú__init__Û s zObjectRepository.__init__c C s. | d¡r|dd
}tj t|¡}| |¡S ©Nrg r )Ú
startswithrQ rR rj Ú_SEGMENT_PREFIXÚ
_full_path©rt ÚpartialrR rV rV rW Ú_full_segment_pathß s
z#ObjectRepository._full_segment_pathc C s* | d¡r|dd
}tj | j|¡}|S rv ©rw rQ rR rj rr rz rV rV rW ry æ s
zObjectRepository._full_pathc C s d S rZ rV )rt rL ÚflagsrV rV rW Ú object_openì s z ObjectRepository.object_openc C s d S rZ rV )rt rL ÚoffÚbufÚfhrV rV rW Ú
object_uploadï s z ObjectRepository.object_uploadc C s d S rZ rV )rt rL Úoffsetr rV rV rW Úobject_downloadò s z ObjectRepository.object_downloadc C s d S rZ rV )rt rL rV rV rW Ú
object_deleteõ s z ObjectRepository.object_deletec C s d S rZ rV ©rt rL r rV rV rW Ú object_closeø s z ObjectRepository.object_closeNc C s d S rZ rV ©rt rL Úlengthr rV rV rW Úobject_truncateû s z ObjectRepository.object_truncatec C s d S rZ rV r rV rV rW Úobject_getattrþ s z ObjectRepository.object_getattrc C s d S rZ rV ©rt rR r rV rV rW Úobject_readdir s z ObjectRepository.object_readdirc C s d S rZ rV ©rt rR ÚmoderV rV rW Ú
object_access s z ObjectRepository.object_accessc C s d S rZ rV ©rt rR rV rV rW Ú
object_unlink s z ObjectRepository.object_unlinkc C s d S rZ rV r rV rV rW Ú
object_statfs
s z ObjectRepository.object_statfs)N)N)Ú__name__Ú
__module__Ú __qualname__ru r| ry r r r
r r r r r r r r rV rV rV rW rq Ú s
rq c s e Zd Z fddZG dd deZG dd dZdd Zd d
Zd d Z d
d Z
dd Z i fddZ dd Z
dd Zdd Zdd Zdd Zd d Zd d Zd!d" Zd#d$ Zd%d& ZdYd(d)Zd*d+ Zd,d- Zd.d/ Zd0d1 ZdZd2d3Z d4d5 Z d6d7 Z d8d9 Z d:d; Z d<d= Z!d>d? Z"d@dA Z#d[dCdDZ$dEdF Z%d\dGdHZ&dIdJ Z'dKdL Z(dMdN Z)dOdP Z*dQdR Z+dSdT Z,d]dUdVZ-dWdX Z. Z/S )^ÚBackendRepositoryc sv t t| j|fi |¤ ttj| _ttj| _i | _ t
t ¡| _
i | _t ¡ | _i | _i | _i | _| dt ¡| _d S )Nr )Úsuperr ru r Ú FUSE_USERÚpw_uidrB Úpw_gidÚgroup_idÚmanifestr Ú S3BackendrN Ú_BackendRepository__backendÚ!_BackendRepository__manifest_lockÚ threadingÚLockÚ#_BackendRepository__open_close_lockÚ_BackendRepository__in_openÚ _BackendRepository__worker_poolÚ _BackendRepository__pending_iosÚBackendWorkerPoolÚ,_BackendRepository__object_open_backend_poolrs ©Ú __class__rV rW ru s
zBackendRepository.__init__c @ s0 e Zd ZdZdd Zdd Zdd Zdd Zd
S ) z BackendRepository.BackendWorkerzU A thread used to asyncronously perform backend jobs placed in the job_queue
c C s8 t | ¡ t |¡| _|| _t ¡ | _d| _ |
¡ d S )NT) r ru r r Ú_BackendWorker__backendÚ_BackendWorker__job_queuer¢ ÚEventÚ _stop_eventÚdaemonÚstart)rt Ú job_queuerN rV rV rW ru 1 s
z(BackendRepository.BackendWorker.__init__c C s | j ¡ d S rZ )r¯ Úset©rt rV rV rW Ústop; s z$BackendRepository.BackendWorker.stopc C s
| j ¡ S rZ )r¯ Úis_setr´ rV rV rW Ústopped> s z'BackendRepository.BackendWorker.stoppedc
C s² t dt ¡ j ¡ | ¡ s®zL| j dd¡\}}}z&|| jg|¢R i |¤ W | j ¡ n | j ¡ 0 W q t
y~ Y qY q t yª } zt |¡ W Y d}~qd}~0 0 qdS )zO Start up the worker and block until there is an item in the queue
zStarting worker thread[%x].Tr N)
rT rI r¢ Úcurrent_threadÚidentr· r Úgetr¬ Z task_doner Ú ExceptionÚ exception)rt ra r^ ÚkargsÚerV rV rW ÚrunA s ÿÿ z#BackendRepository.BackendWorker.runN)r r r Ú__doc__ru rµ r· r¿ rV rV rV rW Ú
BackendWorker- s
rÁ c @ s8 e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd S )
z#BackendRepository.BackendWorkerPoolzU Pool of backend worker threads that consume selected tasks from a job queue
c C s: t tj| _g | _t|D ]}| j t | j|¡¡ qd S rZ ) r rO r# r² ÚworkersÚrangeÚappendr rÁ )rt Z num_threadsrN Ú_rV rV rW ru Z s ÿz,BackendRepository.BackendWorkerPool.__init__c C s, | j D ] }| ¡ q| j D ] }| ¡ qd S rZ )r rµ rj )rt ÚtrV rV rW Ú__del__b s
z+BackendRepository.BackendWorkerPool.__del__c O s | j |||f¡ dS )z+ Add a job to the worker queue
N)r² Zput)rt ra r^ r½ rV rV rW Úadd_jobi s z+BackendRepository.BackendWorkerPool.add_jobc C s |D ]}| ||¡ qdS )z4 Add a list of jobs to the worker queue
N)rÈ )rt ra Z args_listr^ rV rV rW Úmapn s z'BackendRepository.BackendWorkerPool.mapc C s | j ¡ dS )z> Wait for completion of all the jobs in the queue
N)r² rj r´ rV rV rW Úwait_completiont s z3BackendRepository.BackendWorkerPool.wait_completionN) r r r rÀ ru rÇ rÈ rÉ rÊ rV rV rV rW r¨ V s r¨ c C sR t j |¡\}}d}|dvrJ|dkr4t j ||¡}n|}t j |¡\}}q||fS rf rh )rt rR rk rl rm rV rV rW rn y s z!BackendRepository.split_head_tailc C s t j |¡\}}|S rZ ro )rt rR rk rl rV rV rW Ú _get_head
s zBackendRepository._get_headc C s. | d¡r|dd
}tj t|¡}| |¡S rv )rw rQ rR rj rx Ú
_get_cacherz rV rV rW Ú_get_segment_cache s
z$BackendRepository._get_segment_cachec C s* | d¡r|dd
}tj | j|¡}|S rv r} rz rV rV rW rÌ s
z BackendRepository._get_cachec C s6 | |¡\}}t ¡ }||d< t|}| j |¡}|S )NrL )rn rN Úcopyr r Zget_object_manifest)rt rL Ú containerrm Ú_optsr rV rV rW Ú_read_object_manifest s z'BackendRepository._read_object_manifestc
C sd | |¡\}}i }d|d< t ¡ }||d< | ¡ D ]\}} | |d| < q2t|}| j |||¡ d S )NrM zx-static-large-objectrL úx-object-meta-)rn rN rÎ Úitemsr r Zupload_object_manifest)
rt rL Úobject_manifestÚmetadatarÏ rm Z put_headersrÐ rH ÚvaluerV rV rW Ú_write_object_manifest s ÿz(BackendRepository._write_object_manifestc C sB t d| ¡ t ¡ }t|}t| d¡d g}| j ||¡ d S )Nú mkdir, %srg ú -segments) rT r rN rÎ r rx Úlstripr Ú mkdir_object)rt rL rÐ r^ rV rV rW Ú_create_segments_folder® s
z)BackendRepository._create_segments_folderc
C sÎ | |¡\}}t ¡ }|dkr$g }n|g}d |d< d|d< d|d< d|d< d |d< t|}|dkrv||d< | |¡ nd }| j ||¡}i }|d d ¡ D ],\}} d
|v rÀ| || d
¡d < q| ||< q|S ) Nr) Ú delimiterFÚhumanÚtotalsÚlongrm ÚheadersZMetadatarÒ r ) rn rN rÎ r rÄ r Ú stat_objectrÓ ri )
rt rL rÏ rm rÐ r^ ÚstrÕ rH rÖ rV rV rW Ú_get_object_metadata¶ s,
z&BackendRepository._get_object_metadatac C s | |¡\}}| |¡}|tdd@ tjk}| jB | j |t ¡ ¡ | j
|d¡ | j
| d7 < W d n1 sz0 Y | j| \ | j |i ¡ | j |i ¡ || j
vr |tdd@ tjksð|tj@ tjksð|tj@ tjkrLz| |¡}W n6 ty4 t d| ¡ t d¡ | |¡}Y n0 di i| j
|< |D ]V}|d d ¡d } | d
¡d } t| d}
| d d ¡|d < d
|d< || j
| |
< qH| |¡} | j
| | ¡ z&| | j
| d ¡} tj| dd W n tyô Y n0 tjtj |¡dd t |d }
|
t !|¡¡ W d n1 s>0 Y nÐtjtj |¡dd |tj"@ tj"krÞz| #|¡ W n ty Y n0 z0t |d}
W d n1 s¼0 Y W n tyÜ Y n0 z | $|d ¡} tj| dd W n ty Y n0 t ||¡}z| %|¡ | j&| j | |< di i| j
|< dd
i| j
| d |< | '||¡ W | j | (|d ¡ | j
| d (|d ¡ t )|¡ n4| j | (|d ¡ | j
| d (|d ¡ t )|¡ 0 z0t |d}
W d n1 sú0 Y W n ty Y n0 z ddl*m+} || ,¡ W n tyL Y n0 t ||¡}zDzd|i| j
| d |< | -t.j/t0¡| j | |< t1 | j | |< |W W | j" | j
| d8 < W d n1 sÔ0 Y W d S tyb } z\t 2|¡ | j | (|d ¡ | j
| d (|d ¡ | j | (|d ¡ t )|¡ W Y d }~n
d }~0 0 W | j" | j
| d8 < W d n1 s0 Y n<| j" | j
| d8 < W d n1 sÒ0 Y 0 W d n1 sô0 Y d S )NZffé r r z+Manifest for %s not found. Trying in 5 secsr Ú open_handlesÚnameú
-segments/Ú.Ú versionIdr) FÚmodifiedú segments-dirT)Úexist_okÚwrÙ Úreadonly)ÚPath)3rn ry ÚintrQ ÚO_RDONLYr¤ r¡ Ú
setdefaultr¢ ÚRLockr¥ r¦ r§ r ÚO_RDWRÚO_APPENDrÑ r» rT rI ÚtimeÚsleepri rº rä ÚupdateÚmakedirsr] rR ÚdirnameÚopenÚwriteÚjsonÚdumpsÚO_WRONLYr r| rÜ r© Ú
_object_closeÚpopÚcloseÚpathlibrð Útouchr¨ rO r$ rN r³ r¼ )rt rL r~ rÏ rm Ú full_pathrï r ÚsegZoffstrr rÕ Z segment_dirÚfr rð ÚexrV rV rW r ò s
ÿÿ0 ÿþýÿÿÿ
ÿ 4ÿ $ÿ
ÿ ÿÿÿÿÿ ýÿÿ $ ÿÿÿÿ 2ö
4ÿz BackendRepository.object_openc
C sT z t ¡ }t|}| ||¡ W n. tyN } zt |¡ W Y d}~n
d}~0 0 dS )zý Utility method to be dispatched to a worker
thread in order to clean up old segments.
Args:
backend (class instance): Instance of the backend plugin.
segment_list (list): List of segments to remove.
N)rN rÎ r Údelete_object_listr» rT r¼ )rt ÚbackendÚ segment_listrÐ r rV rV rW Z__purge_old_segments_task s z+BackendRepository.__purge_old_segments_taskc C sî | j | | ¡ | j| º zv| j| ddt | d ¡}| |¡\}}g }d}| j| d | d sd}d} d}
|| j| vrqºz | | j| | d |¡} W n6 tyâ t
d¡ | | j| | d |¡} Y n0 | j| | d r:t | } t | j
tj}
| | j| | d | j| j|
| jd
¡ nd| j| | d }
| | j| | d | j| | d d
¡| j| | d |
| j| | d d
¡ |tj7 }|d7 }| |
7 } q|| j|||t|t| dd d}|r| |||¡}
t|
dkrqt|
}
z| j| | d }W n d
}Y n0 | d¡}tt|
t|g }t|dkrz| j | | | j |¡ |tj7 }qÞW W d dS t yÈ } zt |¡ W Y d}~n
d}~0 0 W d n1 sà0 Y dS )zé Handle object_close by updating the manifest.
Waits for all of the background jobs to complete prior to updating
manifest using the main thread. Also queues up tasks to clean up
any old segments.
rì rg rÙ r ræ rï rç r rë )rR rê ÚetagÚ
size_bytesÚ content_typer rê r) Úhashr r ©rì ú
segment-countú
total-size©rÕ TN)!r¦ rÊ r¡ r rº rx rn r r] r÷ rø r ÚminÚst_sizerO r& rÄ Ú
version_idr
r r× Ústrr ÚlenÚsortedÚstripÚlistr³ rÈ Ú+_BackendRepository__purge_old_segments_taskr» rT r¼ )rt rL r Ú segments_dirrÏ rm rÔ Úsegmentsr Z
total_sizeÚ segment_sizerã ÚstatZobjectsÚpZ
purge_listr rV rV rW r sÎ
þÿÿÿþ
þ
ÿ ÿùÿ ÿ ÿÿÿ ÿÿþöÿ
ýý
þz BackendRepository._object_closec C sH | ||¡ | j| | j| |¡ | j| |¡ | j| d |¡ zt |¡ W n tyn Y n0 t | j| d dkrÖz0| j |d ¡}| j |d ¡}t
| |¡¡ W n tyÈ Y n0 | j |¡ | j 6 | j
| s|| jvr| j |d ¡ W d n1 s0 Y W d n1 s:0 Y d S )Nræ r )r r¡ r¦ r r§ r rQ r r] r Úremovery r¤ r¥ )rt rL r ZohZpiosrV rV rW r s* z BackendRepository.object_closec
C sz z,| j | || j| v rH| j| | d du rH| j| | d }n8| ||¡}| j| ddt | d ¡}tj ||¡}t ¡ }d| j| v |d< W d n1 s®0 Y |
|¡\} }
t ||d < |
d¡|d
< t
|}| ||d g} | j| | |¡ | j| | | j| |||||¡ W nF tyt } z,t | ¡ | j| | |¡ W Y d } ~ n
d } ~ 0 0 d S ) Nrë Trç rì rg rÙ Ú0Ú
path_validr rL )r¡ r Ú,_BackendRepository__next_segname_from_offsetrº rx rQ rR rj rN rÎ rn r Úrstripr r§ Úaddr¦ rÈ Ú&_BackendRepository__object_upload_taskr» rT r¼ r# )
rt rL r r r Ú seg_fullnameZsegnamer rÐ rÏ ÚobjÚargs1r rV rV rW r % s@ ÿþÿ
þ0 ý
z BackendRepository.object_uploadc C s t d||t ¡ jf ¡ |d }|d } |dd
}| j| W d n1 sV0 Y zd|_| ||| |¡}
W nn tyè } zVt | ¡ | j| $ | j
| | |¡ W d n1 sÈ0 Y W Y d} ~ n
d} ~ 0 0 | j| || j | vri | j | |< || j | | d< d| j | | d< |
dd ¡| j | | d
< | j
| | |¡ W d n1 s|0 Y dS ) zP Method run by a worker in the thread pool to upload an object segment.
z6Object [%s] segment [%s] upload running in thread[%x].r r% NTrç rë Ú VersionIdr) rê )rT rI r¢ r¸ r¹ r¡ r% Z
put_objectr» r¼ r§ r# r rº ) rt r r, rÐ rL r r* r r Zbuf_lenZrespr rV rV rW Z__object_upload_taskL s4 ÿÿ
2
ÿz&BackendRepository.__object_upload_taskc
C sz t d¡ | j| ~ || j| | v r6W d q || j| vrdtd|tt|tdf | j| | d }W d q¤W d q 1 s0 Y q | | d¡¡\}}i }| j| |
dd¡|d< t |}||g}z| j
||¡} t| W S tyD }
z,|
jd d
d kr.t |
¡ W Y d }
~
n:d }
~
0 tyt } zt | ¡ W Y d } ~ n
d } ~ 0 0 d S ) Ng¹?zobject %s not found r rç rg rê r) r ÚResponseMetadataÚHTTPStatusCodeé )r÷ rø r¡ r§ r r» ÚSEGMENT_FORMATrñ rn r' rº r r Z
get_objectÚ bytearrayr ÚresponserT r¼ ) rt rL r r r* rÏ r+ rÐ r, r r¾ r rV rV rW r
q s:
ÿÿ.ÿ
z!BackendRepository.object_downloadc C sÀ | j |t ¡ ¡ | j | | |¡\}}t ¡ }t|}|g}|dkr\|dkr\| |¡ z| j
||¡ W n. t y } zt
|¡ W Y d }~n
d }~0 0 W d n1 s²0 Y d S )Nr) rg )r¡ ró r¢ rô rn rN rÎ r rÄ r Z
delete_objectr» rT r¼ )rt rL rÏ r+ rÐ r, r rV rV rW r s ÿ
z BackendRepository.object_deleteNc C s& |rd S | |tj¡}| ||¡ d S rZ )r rQ r r r rV rV rW r ¦ s z!BackendRepository.object_truncatec
C s¨ t ¡ }d |d< d|d< d|d< d|d< tj |dt| ¡|d< g }|dkrTg }n|g}t|}z| j ||¡W S t y¢ } zt
|¡ W Y d }~n
d }~0 0 d S ) NrÝ FrÞ rß rà z%016xrm r) ) rN rÎ rQ rR rj rñ r r Z
list_segmentsr» rT r¼ )rt rÏ r r rÐ r^ r rV rV rW r ¬ s
z BackendRepository.segment_listc C sÀ | |¡\}}| j| dd ¡}|rT| dt ¡r@| |¡\}}| |¡\}}|}n|d }| |||¡}t|dkrtt|tdf S tt|tt |d
|¡d
d¡d dd f S ) Nrì rg rÙ r éÿÿÿÿr ré rå ) rn r rº rw rx r r r1 rñ r ri ) rt rR r rÏ rm r Úcr" ÚfilesrV rV rW Z__next_segname_from_offset s" $ÿþz,BackendRepository.__next_segname_from_offsetc
C s | j | ¨ | |¡\}}| j |d ¡rd|| j| v rd| j| | d }| d¡d W d S | j| dd ¡}|r| |¡\}}|}n|d }| |||¡} W d n1 s¸0 Y t| dkrâtt|tdf S tt|tt | d |¡d d¡d d f S )
Nrç rè r rì rÙ r r4 ré rå )
r¡ rn r rº ri r r r1 rñ r )
rt rR r rÏ rm r r r5 r" r6 rV rV rW Úcurr_segname_from_offset× s" , $þz*BackendRepository.curr_segname_from_offsetc
s t j |¡rzBt |¡ t fdddD }d|d< t|d d |d< |W S ty| } zt |¡ W Y d}~n
d}~0 0 dS dS ) aë Utility to check the tmpfs cache and return stat() from that.
This method looks to see if the object (directory) exists in the
local cache and will perform a stat() locally instead of calling
all the way to the backend.
Args:
object_cache_path (str): Cache path to the object we
need stat infor on.
Returns:
Dictionary of stat() information or None if object does not exist.
c 3 s | ]}|t |fV qd S rZ ©Úgetattr©Ú.0rH ©rã rV rW Ú <genexpr> s ÿz0BackendRepository._stat_cache.<locals>.<genexpr>©Úst_atimeÚst_ctimeÚst_gidÚst_modeÚst_mtimeÚst_nlinkr Úst_uidé Ú
st_blksizer Ú st_blocksN) rQ rR ÚisdirÚlstatÚdictrñ r» rT r¼ )rt Zobject_cache_pathÚ stat_infor¾ rV r< rW Ú _stat_cacheð s
þ
z BackendRepository._stat_cachec sÚ | |¡}| |¡\}}t ¡ }|dkr.g }n|g}d |d< d|d< d|d< d|d< d |d< t|}i }|dkr||d< | |¡ nd }z`| j ||¡ | j|d< | j |d < d
d d¡|d < d
d
d¡|d< d
dd¡|d< t d |d< t d |d< t d |d< d|d< d|d< |d urFd|v rFd|d< t d |d < |d d krn|dks¬|d d kr|d u s¬|d d kr|dks¬ d d u rèd |d< d!|d < d"|d< | |¡} t
j | ¡sèt
| d#¡ W nÎ tyj }
zf|
jd$ d% d&krt |
¡ zt
|¡ W n ty< Y n0 tj|d d' t
|¡ W Y d }
~
nXd }
~
0 ty¸ } z6t | ¡ t
|¡ t fd(d)d*D }W Y d } ~ n
d } ~ 0 0 d+|d,< t |d d+ |d-< |S ).Nr) rÝ FrÞ rß rà rm rA rE rá ZETagr
r- r Z ContentTyper Z timestampr? r@ rC r rD ií rB Zauthorized_keyi Úsizer r Z directoryTé i iýA ié r. r/ r0 ©Ú
ignore_errorsc 3 s | ]}|t |fV qd S rZ r8 r: r< rV rW r= ] s ÿz3BackendRepository.object_getattr.<locals>.<genexpr>r> rF rG rH )ry rn rN rÎ r rÄ r râ r rB rº rñ rÌ rQ rR rS Úmkdirr r3 rT r¼ r# r» ÚshutilÚrmtreerJ rK ) rt rL r r rÏ rm rÐ r^ r Zcontainer_pathr¾ r rV r< rW r s
ÿÿ
þþ
ýý
ü
þ z BackendRepository.object_getattrc
C s
zt |d¡}W n0 ty@ } zt |¡ W Y d }~n
d }~0 0 d}|| j| v rÆz | j | j| | d |¡ W n8 ty¬ t
d¡ | j | j| | d |¡ Y n0 || j| | d 7 }qFz| j ||¡ W n, ty t
d¡ | j ||¡ Y n0 d S )Nz%Y-%m-%dT%H:%M:%Sr rç r r ) r Ústrptimer» rT r¼ r r Z put_object_segment_retentionr] r÷ rø Zput_manifest_retention)rt rL Ú retainuntilÚdtr r rV rV rW Ú_set_object_retentionr s,
ÿ
ÿ
z'BackendRepository._set_object_retentionc
C s2 | |tj¡}zzÊ| j| ¬ t | j| ¡}d}|| j| v rj| j| | d }| |d ¡ ||7 }q4| dd ¡ |dkr| || d¡¡ n | d¡||< | j
||¡ || j| |< W d n1 sÐ0 Y W n2 t y } zt
|¡ W Y d }~n
d }~0 0 W | ||¡ n| ||¡ 0 d S )Nr r ræ rV Úutf8úutf-8)r rQ rò r¡ rÎ Údeepcopyr r rX Údecoder Úupdate_object_attributesr» rT r¼ r ) rt rL rç rÖ r Úattrsr rN r rV rV rW Úobject_setxattr s.
ÿÿ0
z!BackendRepository.object_setxattrc
C s | |tj¡}zòz°| j| t | j| ¡}d}|| j| v rh| j| | d }| |d ¡ ||7 }q2| |d ¡ | dd ¡ | j ||¡ | j| |d ¡ W d n1 s´0 Y W n0 t
yð } zt |¡ W Y d }~n
d }~0 0 W |
||¡ n|
||¡ 0 d S )Nr r ræ )r rQ rò r¡ rÎ r[ r r r r] r» rT r¼ r )rt rL rç r r^ r rN r rV rV rW Úobject_removexattr© s&
ÿ4
z$BackendRepository.object_removexattrc
C sÈ | |tj¡}z¦zd| j| F t | j| ¡}| d¡ | ¡ }|W d W W | ||¡ S 1 sh0 Y W n0 t
y¤ } zt |¡ W Y d }~n
d }~0 0 W | ||¡ n| ||¡ 0 d S )Nræ )
r rQ rò r¡ rÎ r[ r r Úkeysr r» rT r¼ )rt rL r r^ ra r rV rV rW Úobject_listxattr¾ s
û
z"BackendRepository.object_listxattrc
C s¶ | |tj¡}zzR| j| 4 t| j| | dW d W W | ||¡ S 1 sV0 Y W n0 ty } zt |¡ W Y d }~n
d }~0 0 W | ||¡ n| ||¡ 0 d S )NrZ )
r rQ rò r¡ Úbytesr r r» rT r¼ )rt rL rç r r rV rV rW Úobject_getxattrÍ s $ û
z!BackendRepository.object_getxattrc
c s g }| d¡d }g }zF|| j |¡7 }|D ]}| | d¡d ¡ q,t|D ]
}|V qNW n0 ty } zt |¡ W Y d }~n
d }~0 0 d S )Nrg r4 ) r' r Ú list_objectsrÄ ri r r» rT r¼ ) rt rL r ZlistingZdir_pathÚdirentsZlstÚrr rV rV rW r Ø s
z BackendRepository.object_readdirc C s d S rZ rV )rt rL r rV rV rW r ç s z BackendRepository.object_accessFc
C sN |t d< t ¡ }t|}|sz¸| |¡}| |¡}g }|D ]}| |d ¡ q<| j ||¡ | d¡}|d urÔ|g} | j | |¡ zt
| |¡¡ W n t
yª Y n0 zt
| |¡¡ W n t
yÒ Y n0 W n0 ty }
zt |
¡ W Y d }
~
n
d }
~
0 0 z| j |¡ W n0 tyH }
zt |
¡ W Y d }
~
n
d }
~
0 0 d S )NrK rç rì )rN rÎ r rÑ rä rÄ r r
rº Ú rmdir_objectrQ ÚrmdirrÌ r] r# r» rT r¼ Zdelete_object_manifest) rt rL rK rÐ Z obj_manifestZ obj_metadatar Úmanr r^ r rV rV rW r ê s>
z BackendRepository.object_unlinkc
C sÒ t ¡ }t|}g }z| j ||¡}W n8 ty^ } z t |¡ tt j
W Y d }~n
d }~0 0 d|d v rt |d }t |d t |d }nd}t |d }i }||d< ||d< ||d< d |d
< d |d < |S ) Nzx-account-meta-quota-bytesrá zx-account-bytes-usedr4 rN Úf_blocksÚf_bfreeÚf_bavailr Úf_favailÚf_frsize) rN rÎ r r râ r» rT r¼ r ÚerrnoÚENOENTrñ ) rt rL rÐ r, Zstvr rk rm rW rV rV rW r
s,
ÿ z BackendRepository.object_statfsc
C sâ t d| ¡ | |¡\}}t ¡ }t|}||g}z| j ||¡ W n0 tyv } zt |¡ W Y d }~dS d }~0 0 |
|¡} |du r|
t j
||¡¡} zt | |¡ W n. tyÜ } zt |¡ W Y d }~n
d }~0 0 dS )NrØ r F)rT r rn rN rÎ r r rÛ r» r¼ rÌ rQ rR rj rú )
rt rR r ZistrÏ r+ rÐ r^ r Ú
cache_pathrV rV rW rR , s$
zBackendRepository.mkdirc
C s | |¡\}}t ¡ }d |d< t|}| d¡d }g }z|| jj|dd7 }W n. ty~ } zt |¡ W Y d }~n
d }~0 0 t
|dkrt t j
z| j | d¡g|¡ W n. tyÞ } zt |¡ W Y d }~n
d }~0 0 tj t| d¡¡}z|| jj|dd7 }W n0 ty< } zt |¡ W Y d }~n
d }~0 0 t
|dkrz| j | d¡g|¡ W n0 ty } zt |¡ W Y d }~n
d }~0 0 z&| |¡} tj | ¡r¼t | ¡ W n tyÒ Y n0 z&| |¡}
tj |
¡røt |
¡ W n ty Y n0 d S )Nrm rg r% )Z max_itemsr )rn rN rÎ r r' r re r» rT r¼ r r rp Z ENOTEMPTYrh rQ rR rj rx rÚ rÍ rI rS rT r] rÌ ) rt rL rÏ r+ rÐ rR Z dir_itemsr Zseg_pathZsegment_cache_pathrr rV rV rW ri L sR
zBackendRepository.rmdirc C sV t d| ¡ z0| |¡\}}| tj ||¡¡}t ||¡W S tyP Y n0 d S )Nz chmod, %s) rT r rn rÌ rQ rR rj Úchmodr] )rt rR r rÏ rm rr rV rV rW rs s zBackendRepository.chmodc C sX t d| ¡ z2| |¡\}}| tj ||¡¡}t |||¡W S tyR Y n0 d S )Nz chown, %s) rT r rn rÌ rQ rR rj Úchownr] )rt rR ÚuidÚgidrÏ rm rr rV rV rW rt s zBackendRepository.chownc C s t dd S )NzNot Applicable)r» ©rt rç ÚtargetrV rV rW Úsymlink s zBackendRepository.symlinkc
C sj | j |d ¡r2t d¡ | j |d ¡r2td| t d||f ¡ |d }z| j|dd W n. ty } zt |¡ W Y d }~n
d }~0 0 zL| |¡}| |¡}| d|d ¡| d|d ¡krØ| j|dd W d S W n tyì Y n0 d
}z¤z| |¡}W n ty Y n~0 |
|¡}| d|d ¡} g }
|D ]4} |
| d | d | d
| dd¡| d d¡ q:| j ||
| |d |d dd d}W n2 t
yÈ } zt |¡ W Y d }~n
d }~0 0 zLzÊ|
|¡} | |¡}| d|d ¡} g }| D ]4} | | d | d | d
| dd¡| d d¡ qü| j ||| |d |d dd z| j|dd W n0 ty } zt |¡ W Y d }~n
d }~0 0 W n2 t
yÊ } zt |¡ W Y d }~n
d }~0 0 W |rfz| j|d
d W n0 ty } zt |¡ W Y d }~n
d }~0 0 nL|rdz| j|d
d W n0 tyb } zt |¡ W Y d }~n
d }~0 0 0 d S )Né z%s in use. Try againzrename, %s -> %sú~T)rK rì rÙ r Frç r r rê r) r )rR r
r rê r r r r r )r rº r÷ rø r» rT r r r¼ rä rÑ rÄ r× r] )
rt ÚoldÚnewZ newbak_namer Z new_metadataZ old_metadataZnewfile_existsZ new_manifestr Znewbak_manifestrj Z old_manifestrV rV rW Úrename s´
ÿ
ÿ
ýÿýÿ
ûÿ
ýý$
"ü"zBackendRepository.renamec C sZ t d| ¡ t|\}}| tj ||¡¡}t|\}}| tj ||¡¡}t ||¡S )Nzlink, %s)rT r rn rÌ rQ rR rj Úlink)rt rx rç rÏ rm Zcache_path_targetZcache_path_namerV rV rW r s zBackendRepository.linkc C sN t d| ¡ t|\}}| |¡}zt ||¡ W n tyH Y dS 0 dS )Nz utimens, %sr )rT r rn rÌ rQ Úutimer] )rt rR ÚtimesrÏ rm rr rV rV rW Úutimens s
zBackendRepository.utimensc C s dS ©Nr rV r rV rV rW Údestroy! s zBackendRepository.destroy)N)N)F)F)N)0r r r ru r rÁ r¨ rn rË rÍ rÌ rÑ r× rÜ rä r r r r r r) r
r r r r& r7 rM r rX r_ r` rb rd r r r r rR ri rs rt ry r~ r r r Ú
__classcell__rV rV rª rW r sZ )# ÿ
< s '%"
*
X
#
7 s
r c @ sp e Zd Zdd Zdd ZdddZdd Zd d d Zd
d Zdd Z dd Z
dd Z dd Z dd Z
dd Zd
S ) Ú FuseCachec C sÚ || _ || _i | _t ¡ | _ttj| _ ttj
| _ t j
| j ¡sz4t | j ¡ t | j t| j d t| j g¡ W qÖ ty Y qÖ0 nHt | j ¡}|j| j ks²|j| j krÖt tjt| j d t| j g¡ d S )Nú:)rr Ú
repositoryÚlrucacher¢ r£ Ú
lrucache_lockr r r rB r r rQ rR rI r= rR rt r r] r! rE rA rO r" )rt rr r rL rV rV rW ru : s*
ÿ
ÿÿzFuseCache.__init__c C s | j ||¡}| jX | j |i ¡ | j| |d ¡}| j| |ttjdt
¡ |t d¡ W d n1 sr0 Y |S )N)Úmaxsize)r ÚlrulockrL Ú writes_before_update_manifest) r r r r ró r r rO r' r¢ r£ ÚNUMBER_UPLOADS_BEFORE_FLUSH)rt rL r~ r ÚitemrV rV rW r P s
ü&zFuseCache.object_openTc C s° t d|t ¡ jf ¡ | j| | }|d }|d T z0| ¡ \}}|d r:| j |||d |¡ q:W n t yz Y n0 W d n1 s0 Y |r¬| j
||¡ d S )Nz Cache object_flush [%s] [%x]r r rë Údata) rT r r¢ r¸ r¹ r Úpopitemr r ÚKeyErrorr )rt rL r Úupdate_manifestr Úcacher rV rV rW Ú object_flush` s$ ÿÿ
ÿ
$zFuseCache.object_flushc C s t d|t ¡ jf ¡ | j||dd | j> | j| |d ¡ t | j| s^| j |d ¡ W d n1 sr0 Y | j
||¡ d S )Nz Cache object_close [%s] [%x]F)r ) rT r r¢ r¸ r¹ r r r r r r r r rV rV rW r w s ÿÿ,zFuseCache.object_closeNc C s | j |||¡ d S rZ )r r r rV rV rW r s zFuseCache.object_truncatec c sR |dkrN|t j t j }|| }t|t j| }|||fV ||7 }||8 }q d S r )rO r& r )rt r r Z
seg_offsetÚbaseÚseg_lenrV rV rW Ú_walk_segments s ÿ zFuseCache._walk_segmentsc C s² t }| j| | d ~ | ||¡D ]^\}}}z | j| | d | d } W n tyr zÆ| j| | d }
t|
tjkrü|
¡ \} } | d rü| j || | d |¡ | j| | d d8 < | j| | d sü| j
||¡ t | j| | d< | j |||¡} d| d| j| | d |< W nB t
yl }
z(t |
¡ W Y d }
~
Y W d d S d }
~
0 0 Y n0 || |||
7 }q(W d n1 s 0 Y t|S )
Nr r r rë r r F©rë r r )r2 r r r] r rO r' r r r r r r
r» rT r¼ rc )rt rL r r r Z
output_bufÚ segoffsetr r Úsegdatar r r r rV rV rW Ú object_read sr ÿÿÿÿÿ
ÿ ÿþ ÿÿþ ÿÿþÿÿÿÿ
.6zFuseCache.object_readc
C sâ t d|t ¡ jf ¡ t|}d}| j| | d | ||¡D ]p\}}} | j| | d }
||
vrTt|
tj krò|
¡ \} } | d rò| j || | d |¡ | j| | d d8 < | j| | d sò| j
||¡ t| j| | d< z4| j |||¡}
|
d u rtd d
|
d |
|< W n* tyP td}
d |
d |
|< Y n0 n |
| d }
t|
|k r|
d
|| t|
¡ ||||
|
|||
< d |
| d< || 7 }qFW d n1 sÐ0 Y t|S )Nz Cache object_write [%s] [%x]r r r rë r r r zObject not foundFr Tó )rT r r¢ r¸ r¹ r r r rO r' r r r r r r
r» r] r2 Úextend)rt rL r r r r Zbufptrr r r r r r r rV rV rW Ú object_writeÍ sb ÿÿÿ
ÿ ÿþ ÿþ ÿÿ
*zFuseCache.object_writec C s t | j |¡|¡S rZ )rQ rR r ry r rV rV rW rR ! s zFuseCache.mkdirc C s | j |¡}t |¡S rZ )r ry rQ ri )rt rR r rV rV rW ri $ s zFuseCache.rmdirc C s | j |¡}t ||¡S rZ )r ry rQ rs )rt rR r r rV rV rW rs ( s zFuseCache.chmodc C s | j |¡}t |||¡S rZ )r ry rQ rt )rt rR ru rv r rV rV rW rt , s zFuseCache.chown)T)N)r r r ru r r r r r r r rR ri rs rt rV rV rV rW r 9 s
;Tr c @ sö e Zd Zd:ddZdd Zdd Zdd Zd;d
d Zd d
Zdd Z dd Z
dd Z dd Z dd Z
dd Zdd Zd d Zd d Zd d! Zd"d# Zd$d% Zd&d' Zd<d(d)Zd*d+ Zd=d,d-Zd.d/ Zd0d1 Zd>d2d3Zd4d5 Z d6d7 Z d8d9 Z dS )?r7 Nc C s& || _ |pt|| _t|| j| _d S rZ )rr r r r r )rt rr r rV rV rW ru 2 s zTrilioVault.__init__c C s | j ||¡ d S rZ )r r r rV rV rW Úaccess: s zTrilioVault.accessc C s | j ||¡S rZ )r rs r rV rV rW rs = s zTrilioVault.chmodc C s | j |||¡S rZ )r rt )rt rR ru rv rV rV rW rt @ s zTrilioVault.chownc C s | j ||¡S rZ )r r r rV rV rW r9 C s zTrilioVault.getattrc C s | j |||¡S rZ )r r_ )rt rR rç rÖ rN rV rV rW ÚsetxattrF s zTrilioVault.setxattrc C s, | d¡s| d¡r tddS | j ||¡S )NZsecurityÚsystemr) rZ )rw rc r rd ©rt rR rç rV rV rW ÚgetxattrI s
zTrilioVault.getxattrc C s | j |¡S rZ )r rb r rV rV rW Ú listxattrN s zTrilioVault.listxattrc C s | j ||¡S rZ )r r` r£ rV rV rW Ú removexattrQ s zTrilioVault.removexattrc c s0 ddg}| | j ||¡¡ |D ]
}|V q d S )Nré z..)r r r )rt rR r rf rg rV rV rW ÚreaddirT s zTrilioVault.readdirc C s2 t | |¡¡}| d¡r*t j || j¡S |S d S )Nrg )rQ Úreadlinkry rw rR Úrelpathrr )rt rR ÚpathnamerV rV rW r¨ Z s
zTrilioVault.readlinkc C s t | j |¡||¡S rZ )rQ Úmknodr ry )rt rR r ÚdevrV rV rW r« l s zTrilioVault.mknodc C s | j |¡S rZ )r ri r rV rV rW ri o s zTrilioVault.rmdirc C s | j ||¡S rZ )r rR r rV rV rW rR r s zTrilioVault.mkdirc C s | j |¡S rZ )r r r rV rV rW Ústatfsu s zTrilioVault.statfsc C s | j |¡S rZ )r r r rV rV rW Úunlinkx s zTrilioVault.unlinkc C s | j ||¡S rZ )r ry rw rV rV rW ry { s zTrilioVault.symlinkc C s | j ||¡S rZ )r r~ )rt r| r} rV rV rW r~ ~ s zTrilioVault.renamec C s | j ||¡S rZ )r r )rt rx rç rV rV rW r s zTrilioVault.linkc C s | j ||¡S rZ )r r )rt rR r rV rV rW r s zTrilioVault.utimensc C s | j ||¡S rZ )r r r rV rV rW rü s zTrilioVault.openc C s | |tj¡S rZ )rü rQ ÚO_CREAT)rt rR r ÚfirV rV rW Úcreate s zTrilioVault.createc C s | j ||||¡}|S rZ )r r )rt rR r r r r rV rV rW Úread s zTrilioVault.readc C s | j ||||¡S rZ )r r )rt rR r r r rV rV rW rý s zTrilioVault.writec C s | j j|||d d S )N)r )r r )rt rR r r rV rV rW Útruncate s zTrilioVault.truncatec C s | j ||¡ d S rZ )r r r rV rV rW Úflush s zTrilioVault.flushc C s | j ||¡ d S rZ )r r r rV rV rW Úrelease s zTrilioVault.releasec C s t d| ¡ | j |¡S )Nz destroy, %s)rT r r r r rV rV rW r ¤ s zTrilioVault.destroy)N)N)N)N)N) r r r ru r rs rt r9 r¡ r¤ r¥ r¦ r§ r¨ r« ri rR r r® ry r~ r r rü r± r² rý r³ r´ rµ r rV rV rV rW r7 1 s8
ú/etc/fuse.confc C s d}t j | ¡r\t| d2}|D ] }d|v r d|vr d} q>q W d n1 sR0 Y |dkrd}t j | ¡r°t| d }| ¡ d d }W d n1 s¦0 Y td d
}| |¡ W d n1 sÚ0 Y t d | ¡ t d ¡ t d d g¡ d S )
Nr rg Zuser_allow_otherú#r zuser_allow_other
ZrtÚ
z/tmp/fuse.conf.tmpZwtr¶ z root:root)
rQ rR rS rü r² rý r= rÎ r# rt )Z conf_fileÚfoundr ÚlineÚsZoutfrV rV rW Ú fuse_conf© s" $
. (
r¼ c
C sV zÊzt | dg¡ W n ty& Y n0 tj | ¡rt | ¡}ttj }tt
j }|j |krf|j
|ksÈt | dtd t
g¡ nHt | dg¡ t |dg¡ t | td t
g¡ t |td t
g¡ W n. tyø } zt |¡ W Y d }~n
d }~0 0 dd t tj¡D t|t|d}d}tj ¡ d kr8d
}t|| |ddddtjd d S ) Nz-lz-Rr z-pc S s& g | ] }t jtj tj|¡d dqS )TrP )rS rT rQ rR rj rO r" )r; ÚxrV rV rW Ú
<listcomp>Ö s ýÿzmain.<locals>.<listcomp>)r TrM F)Z nothreadsZ
foregroundZnonemptyZ
big_writesZ allow_otherZfsname) r= Zumountr] rQ rR rI r! r r r Ú
FUSE_GROUPr rE rA rt rR r» rT r¼ ÚlistdirrO r" r7 r r5 rP r r6 )Z
mountpointZ cacherootZmountpoint_statrB r r Z tvaultpluginZdisable_fuse_threadsrV rV rW Úmain½ sL
ÿ
üÿørÁ c C s< t t t t¡} | t¡ | t¡ ttj tj
dS )z$Main routine that drives fuse mount.N) rX r¼ r r rN Zvalidate_s3_clientZset_retention_moderÁ rO r! r" )Z s3backendrV rV rW r¿ ñ s
r¿ Ú__main__)r¶ )^rÀ rQ ÚgrpÚsysrp r÷ Zgetpassr rÎ rþ rS rc r¢ r Úpwdr r r Ú ImportErrorZqueueZ
cachetoolsr Zfuser r r
r] ZfusepyZbotocore.exceptionsr Zs3fuse.bunch_p3r Z oslo_configr
Z oslo.configZs3fuser r[ Z s3fuse.utilsr r r Z_DEFAULT_LOG_DATE_FORMATrx Z QUEUE_DEPTHZWORKER_POOL_SIZEZBoolOptZcommon_cli_optsZStrOptZlogging_cli_optsZIntOptZgeneric_log_optsZListOptZlog_optsZ
vault_optsrO Z
register_optsZregister_cli_optsr ÚenvironÚflagÚargvZlist_all_sectionsZsectionsZs3fuse.privsepr= r> ZSetupS3FuseLoggingrT rº rN rX ZCACHE_LOW_WATERMARKZCACHE_HIGH_WATERMARKZgetuserr ÚgetgrgidÚgetgidÚgr_namer¿ r1 r re rn rp Úobjectrq r r r7 r¼ rÁ r¿ r rV rV rV rW Ú<module> sì
üüøý ÿü
üüýýÓ5ÿýÿýïýýýýûüýüö ÿýýý·Qþÿþþþþþþýþþþþþþþþþþþþþþþþþþþþª]
ÿ
ô
Ü(%
4 5 yx
4