The banana pepper is a medium-sized member of the chili pepper family with a mild, tangy taste. It is often pickled, stuffed, or used as a raw ingredient in foods. While typically bright yellow, it is possible for them to change to green, red, or orange as they ripen.