Consent is based on choice.
Consent is active, not passive.
Consent is only possible when there is equal power.

Giving in because of fear is not consent.
Going along with something because of wanting to fit in with the group, being deceived or feeling bad is not consent.

If you can't say "No" comfortably, then "Yes" has no meaning. If you are unwilling to accept a "No", then "Yes" has no meaning.