The problem with bread isn't the GI index, it's the wheat used to make the bread. Wheat is very inflammatory in the body. Even if you don't suffer from a gluten allergy, you will feel a lot better by removing gluten from your diet. Your digestive system will feel way better and you will also most likely notice clearer skin and improved energy levels.
A slice of bread here and there for the occasional cheat meal isn't anything to worry about but it's not something you should regularly include in your diet. Stick with gluten free unprocessed carbohydrate sources like brown rice, oatmeal, sweet potato etc.
If you like to make sandwiches, buy corn tortillas and use those as wraps instead of bread.