The packaging originally had a bordered photo of Muppet characters. The picture was held by an illustrated Big Bird, and the logo was the Sesame Street sign, with "My" written where the "CTW" logo is usually printed, and "Home Video" underneath the Sesame Street text. Cookie Monster was also illustrated holding the logo, which had a bite mark on the left. The back of the packaging included a list of other videos in the collection. By 1992, the video covers were redesigned, removing Big Bird and using different border colors. These videos originally came with a small activity book, which was discontinued in the early 1990s.
The title sequence had an animated opening with Cookie Monster biting the street sign, followed by a fade to black and, in many of the releases, Cookie exclaiming "Delicious!" Then the title would appear in either chalk board or printed lettering, with Big Bird announcing the video title. The closing sequence had an illustration of Cookie Monster holding a chalkboard with the credits listed.
Four more were released in 1988: Count it Higher: Great Music Videos from Sesame Street, The Best of Ernie and Bert, The Alphabet Game, and Big Bird's Favorite Party Games.
After this, Random House stopped releasing new videos under the My Sesame Street Home Video label, instead releasing television specials, new-to-video specials without the label, and a new collection called Sesame Songs Home Video. Then in 1994, Random House released two more of these videos: A New Baby in My House, and The Best of Elmo. For both of these videos, Elmo read the video title, and the closing featured stills from the videos. When Random House released Put Down the Duckie, the video featured a promo for the My Sesame Street Home Video line, even though the video itself was not under that name.
In 1995, Sony Wonder started releasing Sesame Street videos. Although those videos that were originally released by Sony Wonder (e.g. Cookie Monster's Best Bites, Do the Alphabet, and Elmocize) had the My Sesame Street Home Video opening, the packaging did not promote My Sesame Street Home Video, and when Genius Entertainment gained the license, most (if not all) re-releases of previous videos edited the opening sequence.
- Sesame Street: Learning About Letters (1986) (Videos)
- Sesame Street: Learning About Numbers (1986) (Videos)
- Big Bird's Story Time (1987) (Videos)
- Count It Higher: Great Music Videos from Sesame Street (1988) (Videos)
- Learning About Letters (1986) (Videos)
- Learning About Numbers (1986) (Videos)
- The Best of Elmo (1994) (Videos)