| Server IP : 23.254.227.96 / Your IP : 216.73.216.7 Web Server : Apache/2.4.62 (Unix) OpenSSL/1.1.1k System : Linux hwsrv-1277026.hostwindsdns.com 4.18.0-477.13.1.el8_8.x86_64 #1 SMP Tue May 30 14:53:41 EDT 2023 x86_64 User : viralblo ( 1001) PHP Version : 8.1.31 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : ON | Perl : ON | Python : OFF | Sudo : ON | Pkexec : ON Directory : /usr/lib/python3.6/site-packages/cloudinit/sources/helpers/__pycache__/ |
Upload File : |
3
�� b8� � @ s@ d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
m Z d dl m Z d dl
mZ d dlmZmZ d dlmZ d dlmZ d dlmZmZmZmZmZm Z m Z d d l m Z d d
l m!Z! d d l"m#Z# ej$e%�Z&d Z'd
Z(dZ)dZ*dZ+dZ,dZ-e!j.dddd�Z/dZ0dd� Z1dd� Z2e1d d � �Z3e1d d � �Z4dd �e5e!j6d!�d"d#�Z7d$d%� Z8e1e#d& fd'd(��Z9e1d)d*� �Z:e d+d,� �Z;d-d.� Z<e1ej=d/�d0d1��Z>e5e5e5e?d2�d3d4�Z@G d5d6� d6�ZAG d7d8� d8eB�ZCG d9d:� d:�ZDG d;d<� d<�ZEG d=d>� d>�ZFG d?d@� d@�ZGe1dGdAdB��ZHe1dHdCdD��ZIdEdF� ZJdS )I� N)�contextmanager)�datetime)�ENOENT)�List�Optional)� ElementTree)�escape)�distros�stages�subp�
temp_utils�
url_helper�util�version)�dhcp)�events)� CFG_BUILTINz a8:3f:81:10zboot-telemetryz system-infoZ
diagnosticZ
compressedi � z'/run/cloud-init/log_pushed_to_kvp_indexzazure-dsz initialize reporter for azure dsT)�name� descriptionZreporting_enabledz�The VM encountered an error during deployment. Please visit https://aka.ms/linuxprovisioningerror for more information on remediation.c s � fdd�}|S )Nc
s* t j� j� jtd�� � | |�S Q R X d S )N)r r �parent)r �ReportEventStack�__name__�azure_ds_reporter)�args�kwargs)�func� �/usr/lib/python3.6/azure.py�impl@ s
z)azure_ds_telemetry_reporter.<locals>.implr )r r r )r r �azure_ds_telemetry_reporter? s r c C s\ | |kr dS d
dd�}|j d�}dj||d �||d �||d �|d |d g�}| |kS ) z�
Azure stores the instance ID with an incorrect byte ordering for the
first parts. This corrects the byte order such that it is consistent with
that returned by the metadata service.
F� c S s( dd� t j| d�D �}|j� dj|�S )Nc S s g | ]}|�qS r r )�.0Zbyter r r �
<listcomp>U s z<is_byte_swapped.<locals>.swap_bytestring.<locals>.<listcomp>r � )�textwrapZwrap�reverse�join)�s�widthZddr r r �swap_bytestringT s z(is_byte_swapped.<locals>.swap_bytestring�-r � � � )r )�splitr& )Z previous_idZ
current_idr) �partsZ
swapped_idr r r �is_byte_swappedK s
r0 c 2 C s: t j� std��tjd� y ttj� �ttj� � } W n, t k
rb } ztd�|�W Y dd}~X nX yXt
j
ddddgd d
�\}}d}|r�d |kr�|j d �d }|s�td
��| t|�d }W nb t
j k
r� } ztd| �|�W Y dd}~X n2 t k
�r } ztd| �|�W Y dd}~X nX y`t
j
dddddgd d
�\}}d}|�r`d |k�r`|j d �d }|�sntd��| t|�d }W nd t
j k
�r� } ztd| �|�W Y dd}~X n2 t k
�r� } ztd| �|�W Y dd}~X nX t
jtddtj| �j� d tj|�j� d tj|�j� d f t
j�}t
j|� |S )z[Report timestamps related to kernel initialization and systemd
activation of cloud-initz1distro not using systemd, skipping boot telemetryzCollecting boot telemetryz*Failed to determine kernel start timestampNz/bin/systemctlZshowz-pZUserspaceTimestampMonotonicT)�capture�=r+ z8Failed to parse UserspaceTimestampMonotonic from systemdi@B z-Failed to get UserspaceTimestampMonotonic: %sz<Failed to parse UserspaceTimestampMonotonic from systemd: %szcloud-init-localZ InactiveExitTimestampMonotonicz;Failed to parse InactiveExitTimestampMonotonic from systemdz0Failed to get InactiveExitTimestampMonotonic: %sz?Failed to parse InactiveExitTimestampMonotonic from systemd: %szboot-telemetryz5kernel_start=%s user_start=%s cloudinit_activation=%s�Z)r Z uses_systemd� RuntimeError�LOG�debug�float�timer Zuptime�
ValueErrorr r. ZProcessExecutionErrorr �ReportingEvent�BOOT_EVENT_TYPEr ZutcfromtimestampZ isoformat�DEFAULT_EVENT_ORIGIN� report_event)Z kernel_start�e�out�_ZtsmZ
user_startZcloudinit_activation�evtr r r �get_boot_telemetryg sx
rB c C sb t j� } tjtddtj� | d | d | d d | d d | d d | d f tj�}tj|� |S )
z%Collect and report system informationzsystem informationztcloudinit_version=%s, kernel_version=%s, variant=%s, distro_name=%s, distro_version=%s, flavor=%s, python_version=%s�releaseZvariantZdistr r+ r �python) r Z system_infor r: �SYSTEMINFO_EVENT_TYPEr Zversion_stringr< r= )�inforA r r r �get_system_info� s
rG )� logger_func)�msg�returnc C s6 t |�r|| � tjtd| tj�}tj|dhd� |S )zReport a diagnostic eventzdiagnostic message�log)�excluded_handler_types)�callabler r: �DIAGNOSTIC_EVENT_TYPEr< r= )rI rH rA r r r �report_diagnostic_event� s rO c C sP t jtj|��}d|jd�d�}tjt| tj |�tj
�}tj |dddhd� |S )zReport a compressed eventzgz+b64�ascii)�encoding�datarK �printZwebhook)rL ) �base64Z encodebytes�zlib�compress�decoder r: �COMPRESSED_EVENT_TYPE�json�dumpsr< r= )Z
event_nameZ
event_contentZcompressed_dataZ
event_datarA r r r �report_compressed_event� s r[ Z def_log_filec C s@ t � }tjd� y�t| d��t}|jdtj� t|j� t |�}t
dj |j� | |�tjd� |j|tj � t
d|j� � tjtt|j� �� W dQ R X W n8 tk
r� } z t
dt|� tjd� W Y dd}~X nX tjd � y$tjd
gd d d
�\}}t
d
|� W n: tk
�r: } z t
dt|� tjd� W Y dd}~X nX dS )az Push a portion of cloud-init.log file or the whole file to KVP
based on the file size.
The first time this function is called after VM boot, It will push the last
n bytes of the log file such that n < MAX_LOG_TO_KVP_LENGTH
If called again on the same boot, it continues from where it left off.
In addition to cloud-init.log, dmesg log will also be collected.z"Dumping cloud-init.log file to KVP�rbr zMDumping last {0} bytes of cloud-init.log file to KVP starting from index: {1})rH zcloud-init.logNz#Exception when dumping log file: %szDumping dmesg log to KVPZdmesgFT)rW r1 z$Exception when dumping dmesg log: %s)�%get_last_log_byte_pushed_to_kvp_indexr5 r6 �open�seek�os�SEEK_END�max�tell�MAX_LOG_TO_KVP_LENGTHrO �format�SEEK_SETr[ �readr Z
write_file� LOG_PUSHED_TO_KVP_INDEX_FILE�str� Exception�repr�warningr )� file_nameZ start_index�fZ
seek_index�exr? r@ r r r �push_log_to_kvp� s2
"
rp c C s� y"t td��} t| j� �S Q R X W n� tk
rd } z&|jtkrTtdt|� t j
d� W Y d d }~X nn t k
r� } z tdt|� t j
d� W Y d d }~X n8 t k
r� } z tdt|� t j
d� W Y d d }~X nX dS )N�rz0Reading LOG_PUSHED_TO_KVP_INDEX_FILE failed: %s.)rH z2Invalid value in LOG_PUSHED_TO_KVP_INDEX_FILE: %s.z2Failed to get the last log byte pushed to KVP: %s.r )
r^ rh �intrg �IOError�errnor rO rk r5 rl r9 rj )rn r> r r r r] & s"
r] c c s6 t j� }t jt jj| �� z
d V W d t j|� X d S )N)r` �getcwd�chdir�path�
expanduser)ZnewdirZprevdirr r r �cd> s
ry c C s t j� rd} nd} | S )Nz
option-245z unknown-245)r Z
is_FreeBSD)Zazure_endpointr r r � _get_dhcp_endpoint_option_nameH s rz )rJ c K s� d}d}d}d}d|kr ||d< |j dd�r6tjd� |j dd�rLtjd � x�td
|d
�D ]�}y(tj| f|�}td | |f tjd � |S tk
r� } z4|| d
kr�td| ||f tjd � ||krȂ W Y dd}~X nX t j
|� q\W t d��dS )zvWrapper around url_helper.readurl() with custom telemetry logging
that url_helper.readurl() does not provide.
�� � � ZtimeoutZretriesNzGIgnoring retries kwarg passed in for communication with Azure endpoint.ZinfinitezHIgnoring infinite kwarg passed in for communication with Azure endpoint.r+ z@Successful HTTP request with Azure endpoint %s after %d attempts)rH r zOFailed HTTP request with Azure endpoint %s during attempt %d with exception: %sz%Failed to return in http_with_retries) �popr5 rl �ranger
ZreadurlrO r6 rj r8 �sleepr4 ) �urlr Zmax_readurl_attemptsZdefault_readurl_timeoutZ sleep_duration_between_retriesZperiodic_logging_attemptsZattempt�retr> r r r �http_with_retriesP s<
r� )�username�hostname�
disableSshPwdrJ c C s$ t jd�}|j| ||d�}|jd�S )Na. <ns0:Environment xmlns:ns0="http://schemas.dmtf.org/ovf/environment/1"
xmlns:ns1="http://schemas.microsoft.com/windowsazure"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<ns1:ProvisioningSection>
<ns1:Version>1.0</ns1:Version>
<ns1:LinuxProvisioningConfigurationSet>
<ns1:ConfigurationSetType>LinuxProvisioningConfiguration
</ns1:ConfigurationSetType>
<ns1:UserName>{username}</ns1:UserName>
<ns1:DisableSshPasswordAuthentication>{disableSshPwd}
</ns1:DisableSshPasswordAuthentication>
<ns1:HostName>{hostname}</ns1:HostName>
</ns1:LinuxProvisioningConfigurationSet>
</ns1:ProvisioningSection>
<ns1:PlatformSettingsSection>
<ns1:Version>1.0</ns1:Version>
<ns1:PlatformSettings>
<ns1:ProvisionGuestAgent>true</ns1:ProvisionGuestAgent>
</ns1:PlatformSettings>
</ns1:PlatformSettingsSection>
</ns0:Environment>
)r� r� r� zutf-8)r$ �dedentre �encode)r� r� r� ZOVF_ENV_TEMPLATEr� r r r �build_minimal_ovf� s
r� c @ sB e Zd Zddd�Zdd� Zd
ejd�dd �Zdejd�d d �Zd
S )�AzureEndpointHttpClientZ WALinuxAgentz
2012-11-30)zx-ms-agent-namez x-ms-versionc C s d|d�| _ d S )NZ DES_EDE3_CBC)zx-ms-cipher-namez!x-ms-guest-agent-public-x509-cert)�extra_secure_headers)�self� certificater r r �__init__� s z AzureEndpointHttpClient.__init__F)rJ c C s, | j }|r | j j� }|j| j� t||d�S )N)�headers)r� �copy�updater� r� )r� r� �securer� r r r �get� s
zAzureEndpointHttpClient.getNc C s0 | j }|d k r"| j j� }|j|� t|||d�S )N)rR r� )r� r� r� r� )r� r� rR �
extra_headersr� r r r �post� s
z AzureEndpointHttpClient.post)F)NN) r �
__module__� __qualname__r� r� r
� UrlResponser� r� r r r r r� � s r� c @ s e Zd ZdZdS )� InvalidGoalStateXMLExceptionz9Raised when GoalState XML is invalid or has missing data.N)r r� r� �__doc__r r r r r� � s r� c @ s* e Zd Zdeeedd�dd�Zdd� ZdS ) � GoalStateTN)� unparsed_xml�azure_endpoint_client�need_certificaterJ c C s || _ ytj|�| _W n8 tjk
rN } ztd| tjd� � W Y dd}~X nX | jd�| _ | jd�| _
| jd�| _ x8dD ]0}t | |�dkrzd
| }t|tjd� t
|��qzW d| _| jd �}|dk o�|�rtjd d
td��. | j j|dd�j| _| jdk�rt
d��W dQ R X dS )ah Parses a GoalState XML string and returns a GoalState object.
@param unparsed_xml: string representing a GoalState XML.
@param azure_endpoint_client: instance of AzureEndpointHttpClient.
@param need_certificate: switch to know if certificates is needed.
@return: GoalState object representing the GoalState XML string.
z!Failed to parse GoalState XML: %s)rH Nz./Container/ContainerIdz4./Container/RoleInstanceList/RoleInstance/InstanceIdz
./Incarnation� container_id� instance_id� incarnationzMissing %s in GoalState XMLzD./Container/RoleInstanceList/RoleInstance/Configuration/Certificateszget-certificates-xmlzget certificates xml)r r r T)r� z/Azure endpoint returned empty certificates xml.)r� r� r� )r� r �
fromstring�rootZ
ParseErrorrO r5 rl �_text_from_xpathr� r� r� �getattrr� �certificates_xmlr r r r� �contents)r� r� r� r� r> �attrrI r� r r r r� � s<
zGoalState.__init__c C s | j j|�}|d k r|jS d S )N)r� �find�text)r� Zxpath�elementr r r r� s zGoalState._text_from_xpath)T)r r� r� ri r� �boolr� r� r r r r r� � s 2r� c @ s� e Zd Zddd�Zdd� Zdd� Zedd � �Zejd
d � �Ze d d � �Z
e e d
d� ��Z e dd� �Z
e dd� �Ze dd� �Ze dd� �ZdS )�OpenSSLManagerzTransportPrivate.pemzTransportCert.pem)� private_keyr� c C s t j� | _d | _| j� d S )N)r Zmkdtemp�tmpdir� _certificate�generate_certificate)r� r r r r� s
zOpenSSLManager.__init__c C s t j| j� d S )N)r Zdel_dirr� )r� r r r �clean_up s zOpenSSLManager.clean_upc C s | j S )N)r� )r� r r r r� s zOpenSSLManager.certificatec C s
|| _ d S )N)r� )r� �valuer r r r� s c C s� t jd� | jd k r"t jd� d S t| j��n tjddddddd d
d d d
| jd d| jd g� d}x*t| jd �D ]}d|krt||j� 7 }qtW || _W d Q R X t jd� d S )Nz7Generating certificate for communication with fabric...z Certificate already generated.�opensslZreqz-x509z-nodesz-subjz/CN=LinuxTransportz-daysZ32768z-newkeyzrsa:2048z-keyoutr� z-outr� r# Z CERTIFICATEzNew certificate generated.) r5 r6 r� ry r� r �certificate_namesr^ �rstrip)r� r� �liner r r r� s4
z#OpenSSLManager.generate_certificatec C s" ddd| g}t j ||d�\}}|S )Nr� Zx509z-noout)rR )r )�actionZcert�cmd�resultr@ r r r �_run_x509_action? s z OpenSSLManager._run_x509_actionc C s2 | j d|�}ddddddg}tj||d�\}}|S ) Nz-pubkeyz
ssh-keygenz-iz-mZPKCS8z-fz
/dev/stdin)rR )r� r )r� r� Zpub_keyZ
keygen_cmd�ssh_keyr@ r r r �_get_ssh_key_from_certF s z%OpenSSLManager._get_ssh_key_from_certc C s6 | j d|�}|jd�}||d d� jd�}dj|�S )a openssl x509 formats fingerprints as so:
'SHA1 Fingerprint=07:3E:19:D1:4D:1C:79:92:24:C6:A0:FD:8D:DA: B6:A8:BF:27:D4:73
'
Azure control plane passes that fingerprint as so:
'073E19D14D1C799224C6A0FD8DDAB6A8BF27D473'
z -fingerprintr2 r+ �:r# ���)r� r� r. r& )r� r� Zraw_fp�eqZoctetsr r r �_get_fingerprint_from_certM s
z)OpenSSLManager._get_fingerprint_from_certc C sj t j|�jd�}|j}ddddd|jd�g}t| j��* tjdjf | j �d d
j
|�d �\}}W d Q R X |S )
z�Decrypt the certificates XML document using the our private key;
return the list of certs and private keys contained in the doc.
z.//Datas MIME-Version: 1.0s< Content-Disposition: attachment; filename="Certificates.p7m"s? Content-Type: application/x-pkcs7-mime; name="Certificates.p7m"s! Content-Transfer-Encoding: base64� zutf-8zuopenssl cms -decrypt -in /dev/stdin -inkey {private_key} -recip {certificate} | openssl pkcs12 -nodes -password pass:T�
)�shellrR N) r r� r� r� r� ry r� r re r� r& )r� r� �tagZcertificates_content�linesr? r@ r r r �_decrypt_certs_from_xml[ s z&OpenSSLManager._decrypt_certs_from_xmlc C sz | j |�}g }i }xb|j� D ]V}|j|� tjd|�r<g }q tjd|�r dj|�}| j|�}| j|�}|||< g }q W |S )z�Given the Certificates XML document, return a dictionary of
fingerprints and associated SSH keys derived from the certs.z[-]+END .*?KEY[-]+$z[-]+END .*?CERTIFICATE[-]+$�
)r� �
splitlines�append�re�matchr& r� r� ) r� r� r? Zcurrent�keysr� r� r� � fingerprintr r r �parse_certificatest s
z!OpenSSLManager.parse_certificatesN)r r� r� r� r� r� �propertyr� �setterr r� � staticmethodr� r� r� r� r� r r r r r� s r� c @ s� e Zd Zejd�Zejd�ZdZdZdZ dZ
e e e
dd�d d
�Zedd �d d
��Zee
dd�dd��Zde
e
e
e
e
d�dd�Zee
dd�dd��ZdS )�GoalStateHealthReportera� <?xml version="1.0" encoding="utf-8"?>
<Health xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:xsd="http://www.w3.org/2001/XMLSchema">
<GoalStateIncarnation>{incarnation}</GoalStateIncarnation>
<Container>
<ContainerId>{container_id}</ContainerId>
<RoleInstanceList>
<Role>
<InstanceId>{instance_id}</InstanceId>
<Health>
<State>{health_status}</State>
{health_detail_subsection}
</Health>
</Role>
</RoleInstanceList>
</Container>
</Health>
z� <Details>
<SubStatus>{health_substatus}</SubStatus>
<Description>{health_description}</Description>
</Details>
ZReadyZNotReadyZProvisioningFailedi N)�
goal_stater� �endpointrJ c C s || _ || _|| _dS )a? Creates instance that will report provisioning status to an endpoint
@param goal_state: An instance of class GoalState that contains
goal state info such as incarnation, container id, and instance id.
These 3 values are needed when reporting the provisioning status
to Azure
@param azure_endpoint_client: Instance of class AzureEndpointHttpClient
@param endpoint: Endpoint (string) where the provisioning status report
will be sent to
@return: Instance of class GoalStateHealthReporter
N)� _goal_state�_azure_endpoint_client� _endpoint)r� r� r� r� r r r r� � s z GoalStateHealthReporter.__init__)rJ c C s� | j | jj| jj| jj| jd�}tjd� y| j|d� W n6 t k
rp } zt
d| tj d� � W Y d d }~X nX tj d� d S )N)r� r� r� �statusz Reporting ready to Azure fabric.)�documentz#exception while reporting ready: %s)rH z Reported ready to Azure fabric.)
� build_reportr� r� r� r� �PROVISIONING_SUCCESS_STATUSr5 r6 �_post_health_reportrj rO �errorrF )r� r� r> r r r �send_ready_signal� s
z)GoalStateHealthReporter.send_ready_signal)r rJ c C s� | j | jj| jj| jj| j| j|d�}y| j|d� W n: tk
rp } z d| }t |t
j d� � W Y d d }~X nX t
j d� d S )N)r� r� r� r� � substatusr )r� z%exception while reporting failure: %s)rH z!Reported failure to Azure fabric.)
r� r� r� r� r� � PROVISIONING_NOT_READY_STATUS� PROVISIONING_FAILURE_SUBSTATUSr� rj rO r5 r� rl )r� r r� r> rI r r r �send_failure_signal� s z+GoalStateHealthReporter.send_failure_signal)r� r� r� r� rJ c C s\ d}|d k r.| j jt|�t|d | j� �d�}| jjtt|��t|�t|�t|�|d�}|S )Nr# )Zhealth_substatusZhealth_description)r� r� r� Z
health_statusZhealth_detail_subsection)�%HEALTH_DETAIL_SUBSECTION_XML_TEMPLATEre r �"HEALTH_REPORT_DESCRIPTION_TRIM_LEN�HEALTH_REPORT_XML_TEMPLATEri ) r� r� r� r� r� r� r Z
health_detailZ
health_reportr r r r� � s
z$GoalStateHealthReporter.build_report)r� rJ c C sJ t � tjd� tjd� dj| j�}| jj||ddid� tjd� d S )Nr z&Sending health report to Azure fabric.z http://{}/machine?comp=healthz Content-Typeztext/xml; charset=utf-8)rR r� z/Successfully sent health report to Azure fabric) rp r8 r� r5 r6 re r� r� r� )r� r� r� r r r r� s
z+GoalStateHealthReporter._post_health_report)NN)r r� r� r$ r� r� r� r� r� r� r� r� r� ri r� r r� r� r� r� r r r r r� � s*
r� c @ s@ e Zd Zd,dd�Zdd� Zedd� �Zedd � �Zed
d � �Z ee
d-d d
���Z ee
dd� ��Z ee
dd� ��Z
ee
dd� ��Zee
d.dd���Ze
dd�dd��Ze
d/eee d�dd��Ze
edd�d d ��Ze
eed �d d ��Ze
ed�d!d"��Ze
eeed#�d$d%��Ze
eeed&�d'd(��Z ee eed)�d*d+��Z dS )0�WALinuxAgentShimNc C s. t jd|� || _d | _d | _d | _|| _d S )Nz5WALinuxAgentShim instantiated, fallback_lease_file=%s)r5 r6 � dhcpoptionsr� �openssl_managerr� �
lease_file)r� �fallback_lease_file� dhcp_optionsr r r r� + s zWALinuxAgentShim.__init__c C s | j d k r| j j� d S )N)r� r� )r� r r r r� 6 s
zWALinuxAgentShim.clean_upc C s t j� } tjj| jj� d�S )Nzdhclient.hooks)r
ZInitr` rw r& �pathsZ get_runpath)Z_pathsr r r �_get_hooks_dir: s z WALinuxAgentShim._get_hooks_dirc C s" | j d kr | j| j| j�| _ | j S )N)r� �
find_endpointr� r� )r� r r r r� ? s
zWALinuxAgentShim.endpointc C s| | j dd�}t|�dkrhd}x.|jd�D ] }t|�dkr@d| }||7 }q(W tjdt|j dd�d��}n
|jd �}tj|�S )
N�\r# r- r� r+ �0z>L� zutf-8) �replace�lenr. �struct�packrr r� �socketZ inet_ntoa)Zfallback_lease_valueZunescaped_valueZ
hex_stringZhex_pairZ packed_bytesr r r �get_ip_from_lease_valueG s
z(WALinuxAgentShim.get_ip_from_lease_valuec C s t jd| d�S )NZ
OPTION_245)�leases_d)r Z networkd_get_option_from_leases)r� r r r � _networkd_get_value_from_leasesW s z0WALinuxAgentShim._networkd_get_value_from_leasesc C s� g }yt j| �}W n. tk
r@ } ztjd| |� d S d }~X nX tjd|� t� }x:|j� D ].}||kr^|j|j d�j
dd�d j d�� q^W t |�dk r�d S |d S d S ) NzFailed to read %s: %sz
content is %s� r r+ z;
"r� r� ) r � load_filers r5 r� r6 rz r� r� �stripr. r� )r� ZleasesZcontentro Z option_namer� r r r �_get_value_from_leases_file^ s & z,WALinuxAgentShim._get_value_from_leases_filec s� i } t j� � tjj� �s(tjd� � d S � fdd�tj� �D �}xn|D ]f}y,tjj|�j dd�}t
j t j
|��| |< W qF tk
r� } ztdj|d��|�W Y d d }~X qFX qFW | S )Nz
%s not found.c s g | ]}t jj� |��qS r )r` rw r& )r! �x)� hooks_dirr r r" ~ s z8WALinuxAgentShim._load_dhclient_json.<locals>.<listcomp>z.jsonr# z {_file} is not valid JSON data)Z_file)r� r� r` rw �existsr5 r6 �listdir�basenamer� rY �loadsr r� r9 re )r� Z
hook_filesZ hook_filer r> r )r r �_load_dhclient_jsonu s
z$WALinuxAgentShim._load_dhclient_jsonc C sF | d kr d S d }x0| D ](}| | j dd �}|d k rtjd� P qW |S )NZ unknown_245z)Endpoint server found in dhclient options)r� r5 r6 )r� Z_valueZ interfacer r r �_get_value_from_dhcpoptions� s
z,WALinuxAgentShim._get_value_from_dhcpoptionsc C s� d}|dk r|}t jd� |dkr8tdt jd� tj� }|dkr`tdt jd� tj� }tj|�}|dkr�tdt jd� | dkr�tdt jd� d}n td| t jd� tj| �}|dkr�t }td | t jd� tj
|�}td
| t jd� |S ) aL Finds and returns the Azure endpoint using various methods.
The Azure endpoint is searched in the following order:
1. Endpoint from dhcp options (dhcp option 245).
2. Endpoint from networkd.
3. Endpoint from dhclient hook json.
4. Endpoint from fallback lease file.
5. The default Azure endpoint.
@param fallback_lease_file: Fallback lease file that will be used
during endpoint search.
@param dhcp245: dhcp options that will be used during endpoint search.
@return: Azure endpoint IP address.
Nz&Using Azure Endpoint from dhcp optionszLNo Azure endpoint from dhcp options. Finding Azure endpoint from networkd...)rH zINo Azure endpoint from networkd. Finding Azure endpoint from hook json...zqNo Azure endpoint from dhclient logs. Unable to find endpoint in dhclient logs. Falling back to check lease filesz%No fallback lease file was specified.z%Looking for endpoint in lease file %sz*No lease found; using default endpoint: %szAzure endpoint found at %s) r5 r6 rO r� r� r r rl r� �DEFAULT_WIRESERVER_ENDPOINTr� )r� Zdhcp245r� r� Zendpoint_ip_addressr r r r� � sP
z WALinuxAgentShim.find_endpoint)rJ c C sV y t jd� tjd|g� W n4 tk
rP } ztd| t jd� W Y d d }~X nX d S )Nz Ejecting the provisioning isoZejectz(Failed ejecting the provisioning iso: %s)rH )r5 r6 r rj rO )r� �iso_devr> r r r � eject_iso� s
zWALinuxAgentShim.eject_isoc C s� d}| j dkr&|dk r&t� | _ | j j}| jdkr:t|�| _| j|dk d�}d}|dk rb| j||�}t|| j| j�}|dk r�| j |� |j
� |S )a� Gets the VM's GoalState from Azure, uses the GoalState information
to report ready/send the ready signal/provisioning complete signal to
Azure, and then uses pubkey_info to filter and obtain the user's
pubkeys from the GoalState.
@param pubkey_info: List of pubkey values and fingerprints which are
used to filter and obtain the user's pubkey values from the
GoalState.
@return: The list of user's authorized pubkey values.
N)r� ) r� r� r� r� r� � _fetch_goal_state_from_azure�_get_user_pubkeysr� r� r r� )r� � pubkey_infor Zhttp_client_certificater� �ssh_keys�health_reporterr r r �"register_with_azure_and_fetch_data� s$
z3WALinuxAgentShim.register_with_azure_and_fetch_data)r rJ c C s@ | j dkrtd�| _ | jdd�}t|| j | j�}|j|d� dS )z�Gets the VM's GoalState from Azure, uses the GoalState information
to report failure/send provisioning failure signal to Azure.
@param: user visible error description of provisioning failure.
NF)r� )r )r� r� r
r� r� r� )r� r r� r r r r �®ister_with_azure_and_report_failure s
z7WALinuxAgentShim.register_with_azure_and_report_failure)r� rJ c C s | j � }| j||�S )a Fetches the GoalState XML from the Azure endpoint, parses the XML,
and returns a GoalState object.
@param need_certificate: switch to know if certificates is needed.
@return: GoalState object representing the GoalState XML
)�"_get_raw_goal_state_xml_from_azure�_parse_raw_goal_state_xml)r� r� �unparsed_goal_state_xmlr r r r
$ s
z-WALinuxAgentShim._fetch_goal_state_from_azurec C s� t jd� dj| j�}y,tjddtd�� | jj|�}W dQ R X W n6 t k
rx } zt
d| t j d� � W Y dd}~X nX t j d � |j
S )
z�Fetches the GoalState XML from the Azure endpoint and returns
the XML as a string.
@return: GoalState XML string
zRegistering with Azure...z!http://{}/machine/?comp=goalstatezgoalstate-retrievalzretrieve goalstate)r r r Nz9failed to register with Azure and fetch GoalState XML: %s)rH z#Successfully fetched GoalState XML.)r5 rF re r� r r r r� r� rj rO rl r6 r� )r� r� Zresponser> r r r r 3 s
z3WALinuxAgentShim._get_raw_goal_state_xml_from_azure)r r� rJ c C s~ yt || j|�}W n6 tk
rH } ztd| tjd� � W Y dd}~X nX djd|j d|j d|j g�}t|tj
d� |S )a Parses a GoalState XML string and returns a GoalState object.
@param unparsed_goal_state_xml: GoalState XML string
@param need_certificate: switch to know if certificates is needed.
@return: GoalState object representing the GoalState XML
z"Error processing GoalState XML: %s)rH Nz, z GoalState XML container id: %sz GoalState XML instance id: %sz GoalState XML incarnation: %s) r� r� rj rO r5 rl r& r� r� r� r6 )r� r r� r� r> rI r r r r N s
z*WALinuxAgentShim._parse_raw_goal_state_xml)r� r rJ c C s> g }|j dk r:|dk r:tjd� | jj|j �}| j||�}|S )a� Gets and filters the VM admin user's authorized pubkeys.
The admin user in this case is the username specified as "admin"
when deploying VMs on Azure.
See https://docs.microsoft.com/en-us/cli/azure/vm#az-vm-create.
cloud-init expects a straightforward array of keys to be dropped
into the admin user's authorized_keys file. Azure control plane exposes
multiple public keys to the VM via wireserver. Select just the
admin user's key(s) and return them, ignoring any other certs.
@param goal_state: GoalState object. The GoalState object contains
a certificate XML, which contains both the VM user's authorized
pubkeys and other non-user pubkeys, which are used for
MSI and protected extension handling.
@param pubkey_info: List of VM user pubkey dicts that were previously
obtained from provisioning data.
Each pubkey dict in this list can either have the format
pubkey['value'] or pubkey['fingerprint'].
Each pubkey['fingerprint'] in the list is used to filter
and obtain the actual pubkey value from the GoalState
certificates XML.
Each pubkey['value'] requires no further processing and is
immediately added to the return list.
@return: A list of the VM user's authorized pubkey values.
Nz/Certificate XML found; parsing out public keys.)r� r5 r6 r� r� �_filter_pubkeys)r� r� r r
�keys_by_fingerprintr r r r n s
z"WALinuxAgentShim._get_user_pubkeys)r r rJ c C s� g }xv|D ]n}d|kr.|d r.|j |d � q
d|krl|d rl|d }|| kr^|j | | � qxtjd|� q
tjd|� q
W |S )a8 Filter and return only the user's actual pubkeys.
@param keys_by_fingerprint: pubkey fingerprint -> pubkey value dict
that was obtained from GoalState Certificates XML. May contain
non-user pubkeys.
@param pubkey_info: List of VM user pubkeys. Pubkey values are added
to the return list without further processing. Pubkey fingerprints
are used to filter and obtain the actual pubkey values from
keys_by_fingerprint.
@return: A list of the VM user's authorized pubkey values.
r� r� zIovf-env.xml specified PublicKey fingerprint %s not found in goalstate XMLzFovf-env.xml specified PublicKey with neither value nor fingerprint: %s)r� r5 rl )r r r� Zpubkeyr� r r r r � s
z WALinuxAgentShim._filter_pubkeys)NN)N)NN)NN) r r� r� r� r� r� r� r� r� r� r r� r� r r r� r r r ri r r r� r� r
r r �listr �dictr r r r r r� * sJ
J
# #r� c
C s* t | |d�}z|j||d�S |j� X d S )N)r� r� )r r )r� r r� )r� � dhcp_optsr r �shimr r r �get_metadata_from_fabric� s
r c
C s4 t | |d�}|st}z|j|d� W d |j� X d S )N)r� r� )r )r� �+DEFAULT_REPORT_FAILURE_USER_VISIBLE_MESSAGEr r� )r� r r r r r r �report_failure_to_fabric� s
r c C s( t d| tjd� t d| tjd� d S )Nzdhclient output stream: %s)rH zdhclient error stream: %s)rO r5 r6 )r? �errr r r � dhcp_log_cb� s r )NNNN)NNN)KrT rY Zloggingr` r� r� r� r$ r8 rU �
contextlibr r rt r Ztypingr r Z xml.etreer Zxml.sax.saxutilsr Z cloudinitr r
r r r
r r Z
cloudinit.netr Zcloudinit.reportingr Zcloudinit.settingsr Z getLoggerr r5 r r; rE rN rX rd rh r r r r r0 rB rG ri r: rO r[ rp r] ry rz r� r� �bytesr� r� rj r� r� r� r� r� r r r r r r r �<module> s� $
T (
5 ? "