Madison Avenue passes through a dozen of Manhattan's zip codes. It runs up and down the East Side of Manhattan, from 23rd Street until it hits the Harlem River at 138th Street.
I will divide them into three sections: Madison Avenue in Midtown (lower Madison Avenue), Madison Avenue on the Upper East Side (mid-Madison Avenue), and Madison Avenue in Spanish Harlem (upper Madison Avenue).
Midtown: 10010 (East 23rd to East 27th Street), 10016 (East 28th to East 40th Street), 10017 (East 41st to East 49th Street), 10022 (East 50th to East 60th Street).
Upper East Side: 10065 (East 61st to East 68th Street), 10021 (East 69th to East 76th Street), 10075(East 77th to East 80th Street), 10028 (East 81st to East 86th Street), and 10128 (East 87th to East 96th Street).
Spanish Harlem: 10029 (East 97th to East 116th Street), 10035 (East 117th to East 130th Streets), 10037 (East 131st to 138th Streets).
So, if the address is Madison Avenue between 35th and 36th Street, then the zip code is 10016. If the address is Madison Avenue between 71st and 72 Street, then the zip code is 10021. If it's Madison Avenue between 127th and 128th Street, then the zip code is 10035.