The expansion joints between the house and patio are coming out. Is this a problem?

The fibrous material in the expansion joints between my house and patio has been squished out. In some places it sticks out by more than an inch. In other spots it is recessed. Should I be concerned? (If it matters, I live in Phoenix, Arizona.) Can I fix this on my own or should I find a handyman? (I can do SIMPLE repairs).