See Kim Kardashian and Kanye West's First Kiss as a Married Couple

05/27/2014 at 11:25 AM EDT

Kim Kardashian and Kanye West celebrated their nuptials in grand style, but they sealed the deal with the sweetest, simple gesture: a kiss.

In one of the new photos released by the couple, they lock lips amidst a wall of flowers as their pastor Rich Wilkerson Jr., looks on. In another, the Givenchy-clad duo hold hands while walking down the aisle as a married couple to the cheers of their guests.

West and Kardashian swapped intimate, soft-spoken vows as their family and friends looked on. The ceremony, which included Andrea Bocelli singing as Kardashian walked the aisle, was 'beautiful' and 'so romantic,' longtime family friend Malika Haqq told PEOPLE. (Get all the wedding and reception details - plus more exclusive photos - in this week's issue of PEOPLE, on newsstands Friday.)

Following the week-long festivities, they are finally enjoying some quiet downtime.

As PEOPLE reported Monday, their baby daughter North flew back home with grandmother, Kris Jenner, leaving West and Kardashian to enjoy a diapers-free honeymoon.

All About Kim & Kanye's Lavish Wedding