o x[h @sddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlmZmZmZmZmZmZmZmZmZmZddlmmmZddlmZmZm Z mZm!Z!m"Z"m#Z#m$Z$m%Z%m&Z&ddl'm(Z(m)Z)ddl*m+Z+dd l,m-Z-dd l.m/Z/dd l0m1Z1dd l2m3Z3dd l4m5Z5m6Z6m7Z7ddl8m9Z9ddl:m;Z;ddldgdgdgddgddgddgdgdggdgddgd d!gd" Z?e@eAZBgd#ZCejDejEd$ZFeeeGeeeeeGeeeGeeGfeeeGeeGeffZHGd%d&d&eIZJGd'd(d(e!jKejLd)ZMd*eGd+eNfd,d-ZOd*eGfd.d/ZPde&jQfd0d1ZRd2d3ZSd4eGd5eeMfd6d7ZT 9d>d:d;ZUde?d;d<Z@eAjBdd=d>ZCdd?d@dAZDdBdCZEddDdEZFddFdGZGdHdIZHdd eIfdJdKZJeAjBddLdMZKeAjBdNdOZLdPdQZMdRdSZNeAjBddTdUZOeAjBdVdWZPeAjBdXdYZQdZd[ZRd\d]ZSe?d^d_ZTd`daZUdbdcZVe1dddeZWdfdgZXd eIfdhdiZYdjdkZZd eIfdldmZ[dndoZ\dpdqZ]drefdsdtZ^dudvZ_ddwdxZ`dyeadzeIfd{d|Zbd}d~ZcdddZddddZedddZfdddZgehddZiehdddZjehddded edefddZkdedededefddZld efddZmddeadedefddZne?dededededed eaf ddZoe1ddZpepjqddZpe?de'd e$e'fddZre?de'd e$e'fddZse?de'de'd e$e'fddZte?ded dfddZue?ded e$efddZve?ded ewfddZxdddZydS)Distroz python3-pipz/usr/libz /etc/hostsz/etc/doas.confz"/etc/sudoers.d/90-cloud-init-usersz /etc/hostnamez /etc/shadowz/var/lib/extrausers/shadowz ^{username}::z^{username}:!:z/usr/share/zoneinfoz root:rootserviceinit_cmdrenderer_configsNnetworking_clsz-Hz-Pz-r)haltpoweroffrebootnet_opsFz/etc/resolv.confosfamilydhclient_lease_directorydhclient_lease_file_regexcCsT||_||_||_||_tj|_tj |_ t ||_ g|_d|_d|_d|_dS)NT)_paths_cfgnamerV networkingr!ALL_DHCP_CLIENTSdhcp_client_priorityiproute2Iproute2rZrRunners_runnerpackage_managers _dhcp_client_fallback_interfaceis_linux)selfracfgpathsrPrPrQ__init__s   zDistro.__init__ci_pkl_versionreturncCsTd|jvs |jjs||_t|dsd|_t|dsd|_t|ds(d|_dSdS)z)Perform deserialization fixes for Distro.rbrjNrkrlT)__dict__rbrVhasattrrjrkrl)rmrqrPrPrQ _unpickles     zDistro._unpicklecCs8t|tr|St|ttfrt|dkrt|Std)Nz?Invalid 'packages' yaml specification. Check schema definition.) isinstancestrlisttuplelen ValueError)rmentryrPrPrQ_validate_entrys  zDistro._validate_entrypkglistc Cstt}t}|D]=}t|tr>|D](\}}|D]!}||}z |t||Wqty;t d|Yqwqq |||q t||fS)zTransform the generic package list to package by package manager. Additionally, include list of generic packages zLCannot install packages under '%s' as it is not a supported package manager!) rsetrwdictitemsr~raddKeyErrorLOGerror)rmrpackages_by_managergeneric_packagesr}package_manager package_list definitionrPrPrQ_extract_package_by_managers,     z"Distro._extract_package_by_managerc Csd}||\}}t}|jD]?}||jt}||B}|||s3td|j | |q|s6q| |} | | | rHt || t| |}q| D]\} } | j dd|jDvrcqS| | |j|jj | dqS|r{t||dS)NzcFailed to install the following packages: %s. See associated package manager logs for more details.z"Package manager '%s' not availablecSsg|]}|jqSrP)ra).0prPrPrQ z+Distro.install_packages..)r)rrriget __class__difference_update availablerdebugraupdateinstall_packagesinfor from_configrhr`rL) rmr error_messagerr total_failedmanagermanager_packagesto_tryfailed manager_typepackagesrPrPrQrsJ        zDistro.install_packagesc Cs|jr|jS|j}t|jdg}|rwt )aaccess the distro's preferred dhcp client if no client has been selected yet select one - uses self.dhcp_client_priority, which may be overridden in each distro's object to eliminate checking for clients which will not be provided by the distro )networkrdz.Using configured dhcp client priority list: %sz4Configured dhcp client %s is not supported, skippingzDHCP client selected: %szDHCP client not found: %s) rjrdrget_cfg_by_pathr`rrr!rc client_nameappendwarningNoDHCPLeaseMissingDhclientError)rmrdconfig_priority found_clientsclient_configured client_classclientrPrPrQ dhcp_client sD      zDistro.dhcp_clientcCst|jdd}tj|dS)zReturn the configured network activator for this environment. :returns: The network activator class to use :raises: NoActivatorException if no activator is found )rr Npriority)rrr`r select_activator)rmrrPrPrQnetwork_activator\s zDistro.network_activatorcCsDt|jdd}tj|d\}}td||||j|d}|S)N)rr"rz-Selected renderer '%s' from priority list: %s)config) rrr`r"selectrrrUr)rmrra render_clsrendererrPrPrQnetwork_rendererhszDistro.network_rendererrcCs||dSN)render_network_state)rm network_staterrPrPrQ_write_network_stateuzDistro._write_network_statecCs4tj|jt|}tj|std||f|S)Nz(Invalid timezone %s, no file found at %s)ospathjoin tz_zone_dirrxisfileIOError)rmtztz_filerPrPrQ _find_tz_filexs   zDistro._find_tz_filecCs|j||Sr)r`r)rmopt_namedefaultrPrPrQ get_optionrzDistro.get_optioncCs||j|<dSr)r`)rmrvaluerPrPrQ set_optionrzDistro.set_optioncCs(|||}|||j||dSr)_select_hostname_write_hostnamehostname_conf_fn_apply_hostname)rmhostnamefqdnwriteable_hostnamerPrPrQ set_hostnames zDistro.set_hostnamecCstS)z?Wrapper to report whether this distro uses systemd or sysvinit.) uses_systemdrPrPrPrQrszDistro.uses_systemdcCtrNotImplementedError)rmcommandargspkgsrPrPrQpackage_commandszDistro.package_commandforcec Csl|jD]0}|std|jqz|j|dWqty3}ztd|j|WYd}~qd}~wwdS)Nz8Skipping update for package manager '%s': not available.rz%Failed to update package using %s: %s)rirrrraupdate_package_sources Exceptionr)rmrrerPrPrQrs zDistro.update_package_sourcescCstd}|dvr dS|S)N)i386i486i586i686r)runame)rmr)rPrPrQget_primary_archs zDistro.get_primary_archcCs"|dg}|s |}t||S)Npackage_mirrors)rr_get_arch_package_mirror_info)rmr) mirror_inforPrPrQrs  z$Distro._get_arch_package_mirror_infocCs||}t||dS)N) data_sourcer)r_get_package_mirror_info)rmr)r arch_inforPrPrQget_package_mirror_infos zDistro.get_package_mirror_infocCstSr)rgenerate_fallback_configrmrPrPrQrszDistro.generate_fallback_configcCst|j}t||d}||||r3tdz|j}Wntjy+tdYdSw| |dStddS)aApply the network config. If bring_up is True, attempt to bring up the passed in devices. If devices is None, attempt to bring up devices returned by _write_network_config. Returns True if any devices failed to come up, otherwise False. )rz/Bringing up newly configured network interfacesz>No network activator found, not bringing up network interfacesTz3Not bringing up newly configured network interfacesF) rr$rrrrr NoActivatorExceptionrbring_up_all_interfaces)rm netconfigbring_uprrrrPrPrQapply_network_configs"      zDistro.apply_network_configcCrrr)rmlocaleout_fnrPrPrQ apply_localezDistro.apply_localecCrrr)rmrrPrPrQ set_timezonerzDistro.set_timezonecCdS)Nz 127.0.0.1rPrrPrPrQ_get_localhost_ipszDistro._get_localhost_ipcCrrrrrPrPrQ get_localeszDistro.get_localecCrrr)rmfilenamerrPrPrQ_read_hostnamerzDistro._read_hostnamecCrrr)rmrrrPrPrQrrzDistro._write_hostnamecCrrrrrPrPrQ_read_system_hostnamerzDistro._read_system_hostnamecCsFtd|z td|gWdStjy"ttd|YdSw)Nz2Non-persistently setting the system hostname to %srz;Failed to non-persistently adjust the system hostname to %s)rrrProcessExecutionErrorrlogexc)rmrrPrPrQrs zDistro._apply_hostnamecCs&t|jd|jr |r |S|s|S|S)Nprefer_fqdn_over_hostname)rget_cfg_option_boolr` prefer_fqdn)rmrrrPrPrQrs zDistro._select_hostnamecCs6g}|D]}|tvrtd||t|q|S)Nz&No distributions found for osfamily {}) OSFAMILIESr|formatextend) family_listdistrosfamilyrPrPrQexpand_osfamilyszDistro.expand_osfamilyc Cs|}|||}|rtj|r||}nd}|\}}g}|r&||kr+|||r5||kr:||kr:|||rK|rK||krKtd||dSt dd|D}t d|t ||D]} z| || Wq_t yzttd|| Yq_w||vr||dSdS)Nz6%s differs from %s, assuming user maintained hostname.cSsg|]}|r|qSrPrP)rfrPrPrQrKz*Distro.update_hostname..z/Attempting to update hostname to %s in %s filesz!Failed to write hostname %s to %s)rrrexistsrrrrrrrr{rrrrr) rmrrprev_hostname_fnapplying_hostname prev_hostnamesys_fn sys_hostname update_filesfnrPrPrQupdate_hostnamesH       zDistro.update_hostnamec Cszd}tj|jrtt|j}n td}tjdd}| }| |}d}|s5| |||d}ndd}|D]*}d} g} t |dkrI|d} t |dkrU|dd} | durc| |krc|| vrcd}q9|rt |} | ||g||| D] }t |dkr| ||dqxt |dkr|j |g|Rqx|rt} |r| d || d |tj|j| d d dSdS) NaddedbaseFTr[rrvz%s imode)rrr hosts_fnr HostsConfrload_text_file make_headerr get_entry add_entryr{ryr del_entriesrwrite write_filegetvalue) rmrrheaderehlocal_ip prev_info need_changer} entry_fqdn entry_aliases new_entriescontentsrPrPrQupdate_etc_hosts_sP         zDistro.update_etc_hostscCs|jstt|_|jS)z7Allow distro to determine the preferred ntp client list)_preferred_ntp_clientsryPREFERRED_NTP_CLIENTSrrPrPrQpreferred_ntp_clientss zDistro.preferred_ntp_clientscCs |dS)N default_user)rrrPrPrQget_default_users zDistro.get_default_userc Ksvt|r td|dSd|vr|d}nd}d|g}d|g}tr/|d|dddd d d d d dddd }dddd}dg}|d} | rt| t rV| d} t| t rgt j d|dddddd| D} d| |d<|d } | r| | |r| r| D]} t| s|| td!| |qd"|vrt |d"|d"<t|D]D\} } | |vr| rt| t r||| | g| |vr||| d#gq||| | gq| |vr| r||| ||| q|d$s|d%r |d&|d&n |d'|d'td(|z tj||d)WdSty:}z ttd*||d+}~ww),z Add a user to the system using standard GNU tools This should be overridden on distros where useradd is not desirable or not available. Returns False if user already exists, otherwise True. z!User %s already exists, skipping.F create_groupsTuseradd --extrausersz --commentz--homez--gidz--uidz--groups --passwordz--shellz --expiredatez --inactivez--selinux-user) gecoshomedir primary_groupuidgroupspasswdshell expiredateinactive selinux_userz--no-user-groupz--systemz --no-log-init) no_user_groupsystem no_log_initr>r=,z The user z) has a 'groups' config value of type dictz22.3z=Use a comma-delimited string or array instead: group1,group2. deprecateddeprecated_version extra_messagecSsg|]}|qSrPstrip)rgrPrPrQrr z#Distro.add_user..r;z created group '%s' for user '%s'r<REDACTEDno_create_homerDz-Mz-mzAdding user %s) logstringzFailed to create user %sN)ris_userrrpopsystem_is_snappyrrrwrxsplitrr deprecateris_group create_grouprkeyssortedrrrrr)rmrakwargsr5 useradd_cmdlog_useradd_cmd useradd_opts useradd_flags redact_optsr=r;groupkeyvalrrPrPrQadd_users                     zDistro.add_userc Ks|d}|dd}gd}|r|d||td|ztj||dd\}}td ||t|}|d d } W| StyU} z ttd || d } ~ ww) zD Add a snappy user to the system using snappy tools snapuserknownF)snapz create-userz--sudoerz--jsonz--knownzAdding snap user %sT)rPcapturez snap create-user returned: %s:%susernameNzFailed to create snap user %s) rrrrrr load_jsonrr) rmrarZrdrecreate_user_cmdouterrjobjrhrrPrPrQ add_snap_users(       zDistro.add_snap_usercstr |j|jg}n|jg}dfdd|jD}|D]4}tj|s'qt |}t dd|t j s@t d|qt d|t ||t j rRdSqd S) z Check whether username exists in shadow files with empty password. Support reading /var/lib/extrausers/shadow on snappy systems. |csg|]}|jdqS)rh)r)rpatternrprPrQr4s z?Distro._shadow_file_has_empty_user_password..^:zUser %s not found in %sz0User %s found in %s. Checking for empty passwordTF)rrSshadow_extrausers_fn shadow_fnr#shadow_empty_locked_passwd_patternsrrr rrefindall MULTILINErr)rmrh shadow_filesshadow_empty_passwd_re shadow_fileshadow_contentrPrprQ$_shadow_file_has_empty_user_password)s4   z+Distro._shadow_file_has_empty_user_passwordc Ksd|vr |j|fi|S|j|fi| }d}d}d}d}d|vr6d}d}|dr4|||dnd}d|vrOd}d}|drM|j||dddnd}|rk|sjd|vrdd}ttd tjd |fd || }nd|vryd}d}|dsyd}|d dr| |n,|s|r|rt d ||| |n|rttd tjd|fd n ttd tjd|fd d|vr|dr| ||dd|vr|dr| ||dn|ddurtjd|ddddd|vr*|d}t|tr|g}n t|trt|}|dur"t|tttfstdt|g}nt|p!g}tt||d|vr`|dg} | sCtd||ddS|d} tj} | d| } | d|} tjt| || ddS)a Creates or partially updates the ``name`` user in the system. This defers the actual user creation to ``self.add_user`` or ``self.add_snap_user``, and most of the keys in ``kwargs`` will be processed there if and only if the user does not already exist. Once the existence of the ``name`` user has been ensured, this method then processes these keys (for both just-created and pre-existing users): * ``plain_text_passwd`` * ``hashed_passwd`` * ``lock_passwd`` * ``doas`` * ``sudo`` * ``ssh_authorized_keys`` * ``ssh_redirect_user`` rdFNplain_text_passwdT hashed_passwd)hashedr>z24.3z5'passwd' in user-data is ignored for existing user %s)loggerversionrequested_levelmsgr lock_passwdzIAllowing unlocking empty password for %s based on empty '%s' in user-datazNot unlocking blank password for existing user %s. 'lock_passwd: false' present in user-data but no existing password set and no 'plain_text_passwd'/'hashed_passwd' provided in user-datazNot unlocking password for user %s. 'lock_passwd: false' present in user-data but no 'passwd'/'plain_text_passwd'/'hashed_passwd' provided in user-datadoassudozThe value of 'false' in user z's 'sudo' configz22.2zUse 'null' instead.rGssh_authorized_keyszZInvalid type '%s' detected for 'ssh_authorized_keys', expected list, string, dict, or set.ssh_redirect_usercloud_public_ssh_keysz^Unable to disable SSH logins for %s given ssh_redirect_user: %s. No cloud public-keys present.z$USERz $DISABLE_USER)options)rnrc set_passwdrrloggingWARNINGr~rrr unlock_passwdwrite_doas_ruleswrite_sudo_rulesrrUrwrxrryvaluesrzrrtypersetup_user_keysDISABLE_USER_OPTSreplace) rmrarZpre_existing_userhas_existing_passwordud_blank_password_specifiedud_password_specified password_keyrX cloud_keys redirect_userdisable_optionrPrPrQ create_userKs                  zDistro.create_userc Csdd|gdd|gf}z tdd|D}Wnty/}ztd|dd |Df|d }~wwzt|Wd StyM}z ttd ||d }~ww) zL Lock the password of a user, i.e., disable password logins r>z-lusermodz--lockcs"|] }t|dr|VqdSrNrwhichrtoolrPrPrQ  z%Distro.lock_passwd..zBUnable to lock user account '%s'. No tools available. Tried: %s.cSg|]}|dqSrrPrcrPrPrQr r z&Distro.lock_passwd..Nz&Failed to disable password for user %snext StopIteration RuntimeErrorrrrrr)rmra lock_toolscmdrrPrPrQrs(zDistro.lock_passwdrac CsLdd|gdd|gf}z tdd|D}Wnty/}ztd|dd |Df|d }~wwz tj|d d gd \}}WntyR}z ttd||d }~ww|rdd|gddd|gf}z tdd|D}Wnty}ztd|dd |Df|d }~wwzt|Wd Sty}z ttd||d }~wwd S)zM Unlock the password of a user, i.e., enable password logins r>z-urz--unlockcsrrrrrPrPrQrrz'Distro.unlock_passwd..zDUnable to unlock user account '%s'. No tools available. Tried: %s.cSrrrPrrPrPrQrr z(Distro.unlock_passwd..Nrrcsz%Failed to enable password for user %sz-dr8z''csrrrrrPrPrQr,s  zTUnable to set blank password for user account '%s'. No tools available. Tried: %s.cSrrrPrrPrPrQr3r z(Failed to set blank password for user %sr)rmra unlock_toolsrr_rlpasswd_set_toolsrPrPrQrs`  zDistro.unlock_passwdc CsBz tdd|gWdSty }z ttd||d}~ww)Nr>z--expirezFailed to set 'expire' for %s)rrrrr)rmuserrrPrPrQ expire_passwd=szDistro.expire_passwdc Csfd||f}dg}|r|dz tj||d|dWdSty2}z ttd||d}~ww)Nz%s:%schpasswd-ezchpasswd for %s)datarPzFailed to set password for %sT)rrrrrr)rmrr>r pass_stringrrrPrPrQrDs   zDistro.set_passwdplist_inrcCs>ddd|Dd}dg|rdgng}tj||ddS)N css"|] \}}d||gVqdS)rsNr)rrapasswordrPrPrQr[rz"Distro.chpasswd..rr)r)rr)rmrrpayloadrrPrPrQrXs  zDistro.chpasswdcCstd}td||t||}|r3td|d|d|kr(tddStd|ddStd dS) Nz^(?:permit|deny)(?:\s+(?:nolog|nopass|persist|keepenv|setenv \{[^}]+\})+)*\s+([a-zA-Z0-9_]+)+(?:\s+as\s+[a-zA-Z0-9_]+)*(?:\s+cmd\s+[^\s]+(?:\s+args\s+[^\s]+(?:\s*[^\s]+)*)*)*\s*$z3Checking if user '%s' is referenced in doas rule %rz!User '%s' referenced in doas ruler[z'Correct user is referenced in doas ruleTz.Incorrect user '%s' is referenced in doas ruleFz/doas rule does not appear to reference any user)rrrwsearchr`)rmrrule rule_pattern valid_matchrPrPrQis_doas_rule_valides(     zDistro.is_doas_rule_validc Cs"|s|j}|D]}|||sd||f}t|dSqdd|g}|D] }|d|q&d|}|d7}tj|sit |g}zt j |d|ddWdSt yh} z t td|| d} ~ ww|t |vrz t ||WdSt y} z t td || d} ~ wwdS) NzHInvalid doas rule %r for user '%s', not writing any doas rules for user!rz# cloud-init User rules for %s%sr rzFailed to write doas file %sz Failed to append to doas file %s)doas_fnrrrrrrrr rrr$rrr append_file) rmrrules doas_filerrlinescontentr.rrPrPrQrsH      zDistro.write_doas_rules /etc/sudoersc Csfd}d}d}tj|rt|}d}n tj|rt|}d}|D]'}|}td|}|s4q%| d} | s>q%tj | } | |krLd}nq%|szF|svddtj dd d |dg} |rgt d ||d | 7}t||d ndtj dd d |dg} d | }t||t d||Wnty} z tt d|| d} ~ wwt|ddS)NrFz/usr/etc/sudoersTz^[#|@]includedir\s+(.*)$r[z?# See sudoers(5) for more information on "#include" directives:rrz#includedir %szUsing content from '%s'rrzAdded '#includedir %s' to %szFailed to write %si)rrr rr splitlinesrLrwrr`abspathrrrrr$rrrr ensure_dir) rmr sudo_basesudoers_contents base_existssystem_sudo_base found_includeline include_match included_dirrrrPrPrQensure_sudo_dirsb            zDistro.ensure_sudo_dirc CsH|s|j}dd|g}t|ttfr!|D] }|d||fqnt|tr0|d||fn d}t|t|d |}|d7}| t j |t j |s|t|g}z t|d |dWdSty{} z ttd|| d} ~ ww|t|vrz t||WdSty} z ttd|| d} ~ wwdS) Nrz# User rules for %sz%s %sz1Can not create sudoers rule addition with type %rrrzFailed to write sudoers file %sz#Failed to append to sudoers file %s) ci_sudoers_fnrwryrzrrx TypeErrorrobj_namerrrrdirnamer rrr$rrrrr) rmrr sudo_filerrrrr.rrPrPrQrsL   zDistro.write_sudo_rulescCsd|g}tr |d|sg}t|rtd|nz t|td|Wnty:t td|Ynwt |dkrd|D]"}t |sRtd||qCtdd d ||gtd ||qCdSdS) Ngroupaddr7z(Skipping creation of existing group '%s'zCreated new group %szFailed to create group %srzCUnable to add group member '%s' to group '%s'; user does not exist.rz-az-GzAdded user '%s' to group '%s') rrSrrVrrrrrrr{rQ)rmramembers group_add_cmdmemberrPrPrQrWs4      zDistro.create_groupc Csld|j|g}z |dkrdt|}Wnty'}ztd|f|d}~ww||g}|r4|||S)Nshutdownnowz+%dz?power_state[delay] must be 'now' or '+m' (minutes). found '%s'.)shutdown_options_mapintr|rr)clsrdelaymessagerrrrPrPrQshutdown_command(s&   zDistro.shutdown_commandcCs2|j}|s d|vr|dg}tj|d|dSdS)zX Reload systemd startup daemon. May raise ProcessExecutionError systemctlz daemon-reloadTrgrN)rTrr)rrrTrrPrPrQ reload_init9s zDistro.reload_initraction extra_argsc Gs|j}|s d|vr*dg}d|gd|gd|gd|gd|gd|gd|gd |gd }n|dg|dg|dg|dg|dg|dg|dg|d gd }|||t|}tj|d |d S) z Perform the requested action on a service. This handles the common 'systemctl' and 'service' cases and may be overridden in subclasses as necessary. May raise ProcessExecutionError rstopstartenabledisablerestartzreload-or-restartzreload-or-try-restartstatus)rrrrrreloadz try-reloadrTr)rTrryr)rrrSrrrTcmdsrrPrPrQmanage_serviceDs.   zDistro.manage_servicelayoutmodelvariantrcCs(|rtdd||||gdSt)N localectlzset-x11-keymap)rrr)rmrrrrrPrPrQ set_keymapis zDistro.set_keymapcCs.tjdd}t|ds|Stj|jddS)NT) needs_exenoexecz cloud-initclouddir)rget_tmp_ancestorr has_mount_optrrr usr_lib_exec)rmtmp_dirrPrPrQget_tmp_exec_pathxs  zDistro.get_tmp_exec_pathrrrcwdc Ks>|rd|dnd}tjdd|d|dd|gfi|S) a` Perform a command as the requested user. Behaves like subp() Note: We pass `PATH` to the user env by using `env`. This could be probably simplified after bionic EOL by using `su --whitelist-environment=PATH ...`, more info on: https://lore.kernel.org/all/20180815110445.4qefy5zx5gfgbqly@ws.net.home/T/ zcd z && rsurKz-czenv PATH=$PATH  )rr)rmrrr rZ directoryrPrPrQdo_as~s z Distro.do_asr lease_filepid_file interface config_filec Cs,|ddd|d|ddg |rd||gS|gS)Nz-1z-vz-lfz-pfz-sfz /bin/truez-cfrP)rrrrrrPrPrQbuild_dhclient_cmds   zDistro.build_dhclient_cmdcCs.|jdurt|_|jstd|j|jS)zADetermine the network interface used during local network config.Nz0Did not find a fallback interface on distro: %s.)rkrfind_fallback_nicrrrarrPrPrQfallback_interfaces  zDistro.fallback_interfacecCs ||_dSr)rk)rmrrPrPrQrs pidcCVt|d}|dur)tt t|WdS1swYtd||dS)=Return the parent pid of a process by parsing /proc/$pid/statrNz&/proc/%s/stat has an invalid ppid [%s]rR_get_proc_stat_by_indexrr|rrrrmatchrPrPrQ get_proc_ppid   zDistro.get_proc_ppidcCr)rNz&/proc/%s/stat has an invalid pgid [%s]rrrPrPrQ get_proc_pgidrzDistro.get_proc_pgidfieldc Csz%tjd|dd}td|}|std||WdSt||WSt y?}ztd||WYd}~dSd}~wt yQtd||||YdSw) z parse /proc/$pid/stat for a specific field as numbered in man:proc(5) param pid: integer to query /proc/$pid/stat for param field: field number within /proc/$pid/stat to return z /proc/%s/statT)quietz,^(\d+) (\(.+\)) ([RSDZTtWXxKPI]) (\d+) (\d+)z*/proc/%s/stat has an invalid contents [%s]Nz Failed to load /proc/%s/stat. %sz4Unable to match field %s of process pid=%s (%s) (%s)) rrrLrwrrrrr`r IndexError)rr"rrrrPrPrQrs:  zDistro._get_proc_stat_by_indexdevicecCsLd}tdr d|g}ntdrdd|g}ntjddddt|dS)Nejectz/lib/udev/cdrom_idz --eject-mediaeject_media_cmdzeject command not foundz.neither eject nor /lib/udev/cdrom_id are found)r descriptionreason)rrr)r%rrPrPrQ eject_medias    zDistro.eject_mediablockdevcCs,tj|}|drtd|||SdS)aReturns underlying block device for a mapped device. If it is mapped, blockdev will usually take the form of /dev/mapper/some_name If blockdev is a symlink pointing to a /dev/dm-* device, return the device pointed to. Otherwise, return None. z/dev/dm-z$%s is a mapped device pointing to %sN)rrrealpath startswithrr)r+r,rPrPrQget_mapped_devices zDistro.get_mapped_devicedevpathc Cstj|}tj|}d|}tj|std||ftj|d}tj|s1td|t | }tj|}tj |}t tj|d }tjd|} | |fS)zconvert an entry in /dev/ to parent disk and partition number input of /dev/vdb or /dev/disk/by-label/foo rpath is hopefully a real-ish path in /dev (vda, sdb..) z/sys/class/block/%sz%s had no syspath (%s) partitionz%s not a partitiondevz /dev/block/%s) rrr,basenamer r|rrrrrstripr) r/rpathbnamesyspathptpathptnumrsyspath disksyspath diskmajmin diskdevpathrPrPrQdevice_part_info s$        zDistro.device_part_infocCr)aEnsure that cloud-init has network connectivity. For most distros, this is a no-op as cloud-init's network service is ordered in boot to start after network connectivity has been achieved. As an optimization, distros may opt to order cloud-init's network service immediately after cloud-init's local service, and only require network connectivity if it has been deemed necessary. This method is a hook for distros to implement this optimization. It is called during cloud-init's network stage if it was determined that network connectivity is necessary in cloud-init's network stage. NrPrrPrPrQwait_for_network1szDistro.wait_for_networkr)NN)F)r)r)rrN)zrMrNrOpip_package_namerrrrrrurtrvr default_ownerrTrrx__annotations__rUrr rr0rrVr rrrerfrZr#_ci_pkl_versionrresolve_conf_fnr]r r^rprrur~ PackageListr rrr rrpropertyr! DhcpClientrr NetworkActivatorrr%rrrrrr staticmethodrabcabstractmethodrrrrrrboolrrrrrrrrrrr rr/r2r4rcrnr~rrrrrryrrrrrrW classmethodrrrrr rrrsetterrr!rr*r.rzr=r>rPrPrPrQrRs     5;                A+ y"4,  $ 6 )    $      #rR) metaclassurltransformationscCsztj|}Wn tyYdSw|j}|durdS|D]}||}|dur,|Sq|}|jdur;d||j}tj|j|dS)a Apply transformations to a URL's hostname, return transformed URL. This is a separate function because unwrapping and rewrapping only the hostname portion of a URL is complex. :param url: The URL to operate on. :param transformations: A list of ``(str) -> Optional[str]`` functions, which will be applied in order to the hostname portion of the URL. If any function (regardless of ordering) returns None, ``url`` will be returned without any modification. :return: A string whose value is ``url`` with the hostname ``transformations`` applied, or ``None`` if ``url`` is unparsable. Nz{}:{})netloc) urllibparseurlsplitr|rportr urlunsplit_replace)rOrPparts new_hostnametransformation new_netlocrPrPrQ&_apply_hostname_transformations_to_url?s"  r\cs2tdddddfddddg}t||S)aH Given a mirror URL, replace or remove any invalid URI characters. This performs the following actions on the URL's hostname: * Checks if it is an IP address, returning the URL immediately if it is * Converts it to its IDN form (see below for details) * Replaces any non-Letters/Digits/Hyphen (LDH) characters in it with hyphens * Removes any leading/trailing hyphens from each domain name label Before we replace any invalid domain name characters, we first need to ensure that any valid non-ASCII characters in the hostname will not be replaced, by ensuring the hostname is in its Internationalized domain name (IDN) representation (see RFC 5890). This conversion has to be applied to the whole hostname (rather than just the substitution variables), because the Punycode algorithm used by IDNA transcodes each part of the hostname as a whole string (rather than encoding individual characters). It cannot be applied to the whole URL, because (a) the Punycode algorithm expects to operate on domain names so doesn't output a valid URL, and (b) non-ASCII characters in non-hostname parts of the URL aren't encoded via Punycode. To put this in RFC 5890's terminology: before we remove or replace any characters from our domain name (which we do to ensure that each label is a valid LDH Label), we first ensure each label is in its A-label form. (Note that Python's builtin idna encoding is actually IDNA2003, not IDNA2008. This changes the specifics of how some characters are encoded to ASCII, but doesn't affect the logic here.) :param url: The URL to operate on. :return: A sanitized version of the URL, which will have been IDNA encoded if necessary, or ``None`` if the generated string is not a parseable URL. .cSst|rdS|Sr)r is_ip_addressrrPrPrQrz&_sanitize_mirror_url..cSs|ddS)Nidnaascii)encodedecoder_rPrPrQr`scsdfdd|DS)Nrc3s |] }|vr |ndVqdSrKNrPracceptable_charsrPrQrs 9_sanitize_mirror_url....rr_rfrPrQr`scSsddd|dDS)Nr]css|]}|dVqdSrerK)rpartrPrPrQrs  rh)rrTr_rPrPrQr`s )LDH_ASCII_CHARSr\)rOrPrPrfrQ_sanitize_mirror_urljs&  rkc Cs$|si}i}|r2|jr2|j|d<td|jr2|jdd}tr'd||d<n |jdkr2d||d<|r<|jr<|j|d<i}|d iD]\}}|||<qF|d iD]2\}}g} |D]} z| |}Wn typYq_wt |}|dur~| |q_|| } | r| ||<qWt d ||S) Navailability_zonez#^[a-z][a-z]-(?:[a-z]+-)+[0-9][a-z]$rr ec2_regionec2regionfailsaferzfiltered distro mirror info: %s) rlrwrr platform_typerprrrrkrrr) rr mirror_filtersubstrnresultsramirror searchlistmirrorstmplfoundrPrPrQrsJ           rcCs8d}|D]}|d}||vr|Sd|vr|}q|S)Narchesr)r)rr)ritemr{rPrPrQrs rrarrcCsHt|dtgdg\}}|std||ft|d}t|d}|S)NrrRz1No distribution found for distro %s (searched %s)r)r find_modulerM ImportError import_modulegetattr)ralocs looked_locsmodrrPrPrQfetchs r /etc/timezone/etc/localtimecCsjt|t|d|r3|r3tj|}|stj|s-|r%t|t ||dSt ||dS)Nr) rr$rxr3rrislinkr del_filesymlinkcopy)rrtz_conftz_localrrPrPrQset_etc_timezones    rcCs.z td}t|jWStyYdSw)Nz/run/systemd/systemF)rlstatstatS_ISDIRst_moder)resrPrPrQrs   r)Nrr)WrIrrrwrstring urllib.parserR collectionsr contextlibriortypingrrrrr r r r r rcloudinit.net.netops.iproute2rnetopsre cloudinitrrrrrrrrrcloudinit.distros.networkingrr4cloudinit.distros.package_management.package_managerr*cloudinit.distros.package_management.utilsrcloudinit.distros.parsersrcloudinit.featuresrcloudinit.lifecycler cloudinit.netr r!r"cloudinit.net.netopsr#cloudinit.net.network_stater$cloudinit.net.rendererr% ALL_DISTROSr getLoggerrMrr1 ascii_lettersdigitsrjrxrDrrLCloudInitPickleMixinABCMetarRryr\rksearch_for_mirrorrrrrrrPrPrPrQs    0 0          '  I+< 8