Field Notices
These field notices are provided as a service to our customers to proactively update them on major issues. This service is provided without any changes in our SLA. The information in this field notice will be updated as we learn more.
46. Field Notice
Date: 02 Nov 2023
Issue Description:
Extension of End-of-Support and End-of-Life Dates for Aviatrix Software Releases
To better serve our customers, Aviatrix has decided to provide a one-time extension to the End-of-Support (EoS) and End-of-Life (EoL) dates for Controllers running release 6.9, 7.0, and 7.1.
Related to this extension, we will also be releasing an additional patch for releases 6.9 and 7.0 before they reach EoL. This patch will provide extended time outside of the 2023 holiday window to support our customers in upgrading to our latest releases.
The previous EoS/EoL timeline was as follows:
| Release | GA Date | EOL Date | EOS Date |
|---|---|---|---|
6.8 |
AUG 09 2022 |
AUG 09 2023 |
NOV 09 2023 |
6.9 |
SEP 09 2022 |
SEP 09 2023 |
DEC 09 2023 |
7.0 |
DEC 08 2022 |
DEC 08 2023 |
MAR 08 2024 |
7.1 |
MAY 11 2023 |
MAY 11 2024 |
AUG 11 2024 |
The updated EoS/EoL Timeframe is as follows:
| Release | GA Date | EOL Date | EOS Date |
|---|---|---|---|
6.8 |
AUG 09 2022 |
AUG 09 2023 |
NOV 09 2023 |
6.9 |
SEP 09 2022 |
JAN 09 2024* |
APR 09 2024* |
7.0 |
DEC 08 2022 |
APR 08 2024* |
JUL 08 2024* |
7.1 |
MAY 11 2023 |
SEPT 11 2024* |
DEC 11 2024* |
-
Dates with an asterisk have been adjusted by this Field Notice.
Always reference the Aviatrix EoS/EoL policy for the most up-to-date information. The EoS/EoL policy is here.
For any clarifications on this Field Notice or for upgrade assistance, please contact Aviatrix Support.
45. Field Notice
Date: 28 October 2023
Severity: High
Image upgrade and new gateway deployment fails.
A gateway state on an Aviatrix Controller might change to "Config_fail" when it is created or just after the image is upgraded. This could occur if the setup had previously applied a patch named "Remove unnecessary packages from gateway" under the Controller’s Software patches section. This issue does not always occur in all regions and clouds, but out of an abundance of caution we recommend all users who have applied the "Remove unnecessary packages from gateway" patch take action.
What is the impact?
Customers who applied the "Remove unnecessary packages from gateway" patch need to update the patches before deploying or upgrading gateways. Otherwise, the gateways might move into a "Config_fail" state.
Who is impacted?
To encounter this problem, the below conditions should be met:
The "Remove unnecessary packages from gateway" patch should show as Patched or Partly Patched on the Controller. To verify the status, go to Aviatrix Controller > Settings > Maintenance > Software Patches.
What is the recommendation?
Aviatrix Systems has updated the patch, and it is now available as a Software Patch.
|
Aviatrix strongly recommends not to attempt a gateway image upgrade or to deploy a new gateway until you update the available patches. |
How to detect the issue?
The gateway will display the config_fail state in the gateway page of the Controller:
In addition, the following log entries appear on the Controller under Aviatrix Controller > Troubleshoot > Logs > Display Aviatrix Command Log > DISPLAY.
Log entry text.
2023-10-26T23:03:05.846367+00:00 ip-10-61-86-154 CLOUDX[25238 26208]:
WARNING email_notifications_manager get_status_change_notif_email_address 216 : Status change
notification email address cannot be retrieved.'NoneType' object has no attribute 'get'
tools.packages.PackageUpdateError: Command '['apt-get', 'purge', '-y', 'apport', 'aptitude',
'apt-show-versions', 'apt-xapian-index', 'man-db', 'mlocate', 'nginx-core', 'nginx-common',
'nginx', 'ubuntu-advantage-tools', 'update-notifier-common']' returned non-zero exit status
100.How to fix and avoid the issue?
Aviatrix has updated the "Remove unnecessary packages from gateway" patch.
-
Prior to performing an image upgrade or deploying a gateway in the current release, please go to Aviatrix Controller > Settings > Maintenance > Software Patches and click on UPDATE AVAILABLE PATCHES. Once the patches are updated, a gateway image upgrade or gateway deployment can be performed. The update of the available patches is required to be done one time per Controller unless a Controller upgrade or a Controller migration is performed.
-
Whenever a Controller software upgrade (Platform Upgrade) is performed, you are required to Update Available Patches again before performing an image upgrade or gateway deployment. Please go to Aviatrix Controller > Settings > Maintenance > Software Patches and click on UPDATE AVAILABLE PATCHES.
-
Whenever a Controller Migration is performed, once the backup restore completes on the new Controller and all gateways are connected to it, you are required to Update Available Patches again before performing an image upgrade or gateway deployment. Please go to Aviatrix Controller > Settings > Maintenance > Software Patches and click on UPDATE AVAILABLE PATCHES.
44. Field Notice
Date: 25 October 2023
Who is impacted: Customers modifying rules in the Egress FQDN Filtering feature
Issue Description:
A critical issue identified within the Aviatrix Controller may impact your rule modifications in the Egress FQDN Filtering feature.
In versions 7.1.1710, 7.1.1794, and 7.1.1906, when you attempt to edit an existing FQDN Egress rule under a specific tag and click Save and Update, the Controller removes other rules with the same tag. This unexpected behavior can lead to an outage that may impact your business operations.
Workaround
To avoid encountering this issue, we recommend adding or deleting rules instead of modifying existing rules.
If you do need to modify an existing rule, use the following workaround:
-
Export the rules.
-
Modify the rules as needed in the text file.
-
Make sure no filters are in use in the Edit screen for the rules. Then, import the file with the modified rules.
-
Click Save and Update.
If you have already encountered the issue, please follow the above workaround. Our team highly recommends upgrading to version 7.1.2131, where this issue has been resolved, or a later release.
42. Field Notice
Date: 13 April 2023
(The content of this field notice was revised for clarity on 04/17/2023.)
Issue Description:
For all current Controller software versions (all versions earlier than 7.0.1726), Aviatrix gateways are exporting files to a remote log collection entity. Starting in Controller software version 7.0.1726, instead of exporting files to a remote log collection entity, the Aviatrix Controller and gateways will start streaming the log lines being written to “Syslog” and “Auth.log”.
When you use the default rsyslog server configuration suggested in Aviatrix Documentation, the logs streamed from the Controller and gateways will now have multiple files. Each file will be named with the application that generated the log.
For example: All logs generated by the avx-gw-state-sync application would be re-directed to a file named "avx-gw-state-sync" on the log server.
There will be a change in log format. You must change your syslog collectors and any related automation to accept the new log format.
Old format:
Mar 23 19:17:50 GW-UdpGateway-50.17.41.173 syslog 2023-03-05T19:17:50+00:00 GW-UdpGateway-50.17.41.173 avx-gw-state-sync[11249]: warn#011gateway_launcher/gateway_launcher.go:212#011daemon exited
New format:
Mar 23 19:17:50 GW-UdpGateway-50.17.41.173 avx-gw-state-sync[11249]: warn#011gateway_launcher/gateway_launcher.go:212#011daemon exited
Prefix of old format: Mar 23 19:17:50 GW-gg-aws-usw2-s127-35.162.124.66 syslog 2023-03-05T19:17:50+00:00
Prefix of new format: Mar 23 19:17:50 GW-gg-aws-usw2-s127-35.162.124.66
41. Field Notice
Date: 28 Nov 2022
Change in Default Behavior
The latest 7.0 version of Aviatrix controller introduces a token verification to Aviatrix’s private API.
Please take notice of a change in behavior beginning with Aviatrix Controller version 7.0. The 7.0 version introduces token-based Controller API operations that binds Aviatrix’s private API usage by Aviatrix API Legal Terms of Use*.
To allow time for customers to make necessary changes in their infrastructure to support token-based API operations, we will not enforce a strict check for the token in the 7.0 release. Therefore, Aviatrix’s private API will continue to work for your existing use cases while running 7.0. However, token checking will be enforced in a later release.
Who is impacted?
Direct users of Aviatrix’s private API would be impacted by this change. There is no impact to users of Aviatrix Terraform Provider, Aviatrix CoPilot and Aviatrix Controller UI. Customers who have a Controller HA set up would also be affected. After upgrading to the release with token enforcement enabled, recreate your Controller HA configuration. Use HA script 2.01 or above. For details on HA script version, refer to Controller HA.
Recommended Solution:
To insulate customers from our evolving private API, Aviatrix strongly recommends you switch to Aviatrix Terraform Provider for all operations involving automation.
If you have special need to still use Aviatrix’s private API, please reach out to Aviatrix Support by opening a ticket at Support Portal at https://support.aviatrix.com for guidance on Aviatrix’s private API token generation.
Please mention your Aviatrix private API use case(s) in your ticket for us to better understand your automation needs, thereby enhancing our Terraform Support.
*Aviatrix API Legal Terms of Use:
Use of Aviatrix API software (“Developer Software”) is governed by the Customer Terms of Use. We reserve the right to rescind any license to the Developer Software at our sole discretion without prior notice. DEVELOPER SOFTWARE IS MADE AVAILABLE BY US TO YOU ON AN “AS IS” AND “AS AVAILABLE” BASIS, (I) WITHOUT ANY REPRESENTATION OR WARRANTY OF ANY KIND, WHETHER EXPRESS, IMPLIED OR STATUTORY TO THE FULLEST EXTENT PERMITTED BY LAW AND (II) WITHOUT ANY OBLIGATION OF US TO PROVIDE TECHNICAL SUPPORT OR ANY INDEMNITY FOR YOUR ACCESS TO, AND USE OF, THE DEVELOPER SOFTWARE.