“They seemed very happy,” a source tells of the couple who wed in September

Justin Bieber and Hailey Bieber got away for some fun in the sun.

A source tells PEOPLE that Justin and Hailey — who have been married for six years — traveled to Costa Rica this weekend for fashion consultant Lauren Perez’s brother’s wedding.

“They attended a wedding but also had special alone time,” the source says of their “romantic” getaway. “They seemed very happy.”

Hailey and Justin Bieber in December 2024

On Monday, Dec. 16, Justin, 30, also shared an Instagram Carousel of photos that appeared to chronicle his weekend with the Rhode founder, 28.

In the first photo, Hailey can be seen making a kissy face against Justin’s cheek. The second image features a palm tree at sunset, while the third shows the pop star kissing his wife’s cheek. In the fourth snap, Hailey poses in a rose-emblazoned red dress in the sun, while Hailey smiles and Justin tips his baseball cap in the fifth image.

What follows are a few blurry images of the “Baby” singer, a solo shot of Hailey, an image of Justin golfing and a video of the ocean at sunset.

Last month, a source told PEOPLE that the couple was brushing off rumors that their marriage was on the rocks.

An insider said that three months after welcoming their son Jack Blues, the pair were doing well and had been ignoring any rumors otherwise.

“They laugh at the constant divorce rumors,” the source said. “It’s annoying but just noise.”

Justin and Hailey celebrated their sixth wedding anniversary in September. They previously wed in a New York City courthouse in 2018 and celebrated with a larger wedding a year later in South Carolina.

On her Instagram Stories, Hailey posted about their festive anniversary celebrations, which featured balloons and romantic candles.

“6 years,” she wrote over a Polaroid photo of her and Justin kissing, alongside a heart and a ring emoji. “Love you 𝑏𝑎𝑏𝑦.”

The anniversary came weeks after the pair welcomed their son Jack Blues in August, which they announced by sharing a photo of his foot to Instagram.

“They seem even more in love since the 𝑏𝑎𝑏𝑦 arrived,” an insider told PEOPLE at the time. “[Justin’s] been in a happy bubble since 𝑏𝑎𝑏𝑦 Jack was 𝐛𝐨𝐫𝐧. He wants to focus on being a great dad and husband.”