New Orleans indie rock artists have always been a part of the city’s music scene.

Before the Foo Fighters made the Preservation Hall Jazz Band frequent collaborators; before Arcade Fire’s Win Butler became a courtside staple at Pelicans games; before New Orleans became a chic destination for rockers both mainstream and obscure, there was Foburg.

The Foburg Festival, which first debuted ten...