The Pains Of Being Pure At Heart

From Lastfm:

The Pains of Being Pure at Heart is an indie pop band which formed in 2007 in New York City, New York, United States. They consist of Kip Berman (vocals, guitar), Peggy Wang (vocals, keyboards), Alex Naidus (bass) and Kurt Feldman (drums). Feldman also plays guitar and sings in The Depreciation Guild.

From Wikipedia:

The Pains of Being Pure at Heart are an indie pop band from New York City. Their first album was a self-released EP which came out in 2007 through the Painbow label. Their debut self-titled full length album was released on February 3, 2009 via Slumberland Records. The band name comes from an unpublished children's story of the same title that a friend of singer Kip Berman wrote. The group's self-titled album peaked at #9 on the Billboard Heatseekers chart. On September 22, 2009, they released Higher Than the Stars, their second EP.