Cisco ACI Multi-site Initial Setup Configuration on Nexus Dashboard

Topology:

This Lab is based on Dcloud resources:

• Nexus Dashboard
• ACI Simulators

We will go through the day 0 configuration for ACI Multi-site:

I- Add sites to Nexus Dashboard

After adding the site to the Cisco Nexus Dashboard (NDO), you must move them into a managed state in the Multi-Site Orchestrator (MSO).

In MSO, under Infrastructure > Sites, we will see the sites added via ND in Unmanaged state:

Select Managed and chose the site ID to assign to the selected site:

II- Day-0 Infrastructure Configuration

1- Make sure BGP Route configuration is done on each site:

2- L3Domain for Multi-site

ON each Site navigate to: Under Fabric > Access Policies > Create a L3Domain:

3- BGP and OSPF Infra Configuration:

• In MSO, Under Infrastructure > Infra Configuration:

• Click on Configure Infra then select Site to configure, We will start with Spine1 Interfaces configuration:

• Click on Spine1 and Add Port:

• Click on Save:

• Toggle the button to enable BGP Peering and enter the BGP-EVPN Router RID for the Spine:

Inter-site control plane: Endpoint reachability information is exchanged across sites using a Multiprotocol-BGP (MP-BGP) Ethernet VPN (EVPN) control plane. This approach allows the exchange of MAC and IP address information for the endpoints that communicate across sites. MP-BGP EVPN sessions are established between the spine nodes deployed in separate fabrics.

• Configure Dataplane UNICAST TEP:

• Complete the Underlay and Overlay configuration for the site:

Overlay Multicast TEP and select:

• External Routed Domain
• ASN

OSPF Area ID and Type (With ISN):

Click on Deploy:

On the APIC of each site, in the Infra Tenant, we can verify the configuration pushed from the MSO to the APIC:

First thing, we notice that there is a notice about the fact that this object configuration was done via MSO:

The router ID of the Spine was configured according to MSO inputs:

We can see that the Router-ID is also configured as Intersite Loopback:

Also, the BGP peer was configured to the other site Spine Router-ID:

4- Add the Multipod Data Plane TEP configuration:

The Multipod Dataplane TEP represents the next-hop for all the EVPN prefixes (MAC and IP addresses for locally discovered endpoints) advertised between pods.

Navigate to Tenants > infra > Policies > Protocol > Fabric Ext Connections Policies and click Fabric Ext Connection Policy.