Where-Object to match from Left to Right on all prerequires? - powershell

Question

See the below example code.
I have several objects I need to match on several prerequires.
Lets say I want my Where-Object to not match when the NameRegex is one of the 2 values, the name not equals DisplayName1 and the AccessRights not match.
This means that when I run the below code I want to get Object $User1 back.
This is not happening what so ever.
Should I do this the other way around and then match them in some sort of hashtable?
Has anyone figured this out for a single Where-Object?
$User1 = [PSCustomObject]#{
Name = 'Name1'
DisplayName = 'DisplayName1'
AccessRights = 'AccessRights1'
}
$User2 = [PSCustomObject]#{
Name = 'Name2'
DisplayName = 'DisplayName2'
AccessRights = 'AccessRights2'
}
$User3 = [PSCustomObject]#{
Name = 'Name3'
DisplayName = 'DisplayName3'
AccessRights = 'AccessRights3'
}
$Test = $User1,$User2,$User3
$NameRegex = '^Name2$|^Name3'
$ACRegex = '^AccessRights2$|^AccessRights3$'
$Test | Where-Object { $_.Name -notmatch $NameRegex -and $_.DisplayName -ne 'DisplayName1' -and $_.AccessRights -notmatch $ACRegex }
And some others I've tried:
$Test | Where-Object { ($_.Name -notmatch $NameRegex -and $_.DisplayName -ne 'DisplayName1' -and $_.AccessRights -notmatch $ACRegex) }
$Test | Where-Object { ((($_.Name -notmatch $NameRegex) -and $_.DisplayName -ne 'DisplayName1') -and $_.AccessRights -notmatch $ACRegex) }
$Test | Where-Object {$_ -notmatch ((($_.Name -notmatch $NameRegex) -and $_.DisplayName -ne 'DisplayName1') -and $_.AccessRights -notmatch $ACRegex) }