What is attached by rubber band to this journal? If you get this one, take the credit!

Answer follows.

You're right! It's part of a dessicated opercle from a Brevoortia tyrannus.

In other words, a dried-up gill cover of an Atlantic menhaden.