If you're trying to customize the accordion here is a starting point. Please use the code inside the dedicated area for Custom CSS Code under the Theme Options Panel:

.rbAccordion.large h4:before {
} > section > div:before {

The following chunk of code will remove the "A" and will add a cloud icon. To add a different general icon you'll have to get it's code from this page: (by inspecting the icon with the Element Inspector in Chrome - F12 - and checking the 'content' property).

You cannot add icons to each accordion item, or at least not easy. I just gave you a tip on how to customize the accordion, but you'll have to work yourself around this, since this is a lot of custom work which is not included in the theme support. 

But what i wrote here, is a good starting point ;)