Why Did You Come?

The Earl family elders looked at Grey in shock. People would usually run away if the Smith family was after them, well, people without sufficient backings. Yet, here Grey was, offering himself up so that they would be pardoned. This further increased the beliefs in their mind that Grey's background was terrifying. 

"Hmm, although handing you over to the Smith family would help us pass through this difficult time, I don't agree with it." The leader replied after a moment of silence. 

The reason for his refusal was simple: what if the strong backing behind Grey decided to act against them because they put him in danger, then what? They could still somewhat deal with the Smith family, although barely, they were still holding on. But if the terrifying force behind Grey decides to act, then they might be doomed.