If the fence is on their property, you do not have to pay anything towards it nor is it your responsibility to maintain the fence. Also, when we put a split rail fence up long ago, it had to be a certain amount of feet away from the property line. That was in NJ so don't know if that holds true where you are.
I would not even get into a discussion with your neighbors regarding the fence or even suggest contributing towards it, jmo.