Evaluate generative AI in test and production
    Test for quality and regression with AI and heuristics in dev and CI/CD. Then, evaluate and monitor in production.
    14 day trial (no credit card required)
    Screenshot
    Automate grading in test
    Stop using spreadsheets. Use AI, heuristic, and human evaluators to better evaluate for regressions and hallucinations.
    Factualness
    Similarity
    Conciseness
    Conceptual overview
    Monitor and grade production
    Grade production runs using evaluators (coming soon) and end-user feedback. Monitor in production for speed and cost.
    Pipeline Runs
    Feb 04Feb 11Feb 18Feb 25Mar 030500010000
    Speed
    Feb 04Feb 11Feb 18Feb 25Mar 030 ms2000 ms4000 ms6000 ms8000 ms10000 ms12000 ms
    Cost
    Feb 04Feb 11Feb 18Feb 25Mar 030.000¢0.500¢1.000¢1.500¢2.000¢
    Screenshot
    Trace and test agents
    See agent & chain traces in test and production. Then, use Processors to simplify trace data for evaluation.
    1. Trace
    00m 00s
    00m 10s
    00m 20s
    00m 30s
    00m 40s
    00m 50s
    01m 00s
    01m 10s
    01m 20s
    01m 30s
    01m 40s
    01m 50s
    02m 00s
    02m 10s
    02m 20s
    02m 30s
    02m 40s
    02m 50s
    03m 00s
    03m 10s
    Sep 07 16:30:50
    109 s
    13.41¢
    16:30:50.947
    gpt-4-0613
    4.08 s
    0.51¢
    SYSTEM
    You are a helpful agent completing tasks for the user. You have access to functions to make this possible. If you fail to complete the user's query, carefully try again with other tools. Please be complete. When you use a web page to answer a query, please link to it in your response.
    USER
    What are eater's top brunch places in SF?
    ASSISTANT (FUNCTION CALL)
    bingWebSearch({ "query": "Eater top brunch places in SF" })
    16:30:55.033
    680 ms
    0.00¢
    Inputs
    { "{query}": { "query": "Eater top brunch places in SF" } }
    Outputs
    { "value": "[{\"id\":\"https://api.bing.microsoft.com/api/v7/#WebPages.0\",\"name\":\"The Best Brunch Restaurants in San Francisco - Eater SF\",\"url\":\"https://sf.eater.com/maps/best-brunch-san-francisco\",\"thumbnailUrl\":\"https://www.bing.com/th?id=OIP.1Id3XqjYqtWprXbKcIOhkAHaFj&w=80&h=80&c=1&pid=5.1\",\"isFamilyFriendly\":true,\"displayUrl\":\"https://sf.eater.com/maps/best-brunch-san-francisco\",\"snippet\":\"17 San Francisco Restaurants With Spectacular Views Hilda and Jesse Hilda and Jesse is the hottest brunch spot in North Beach, where diners can break into stacks of fan-favorite buttermilk...\",\"dateLastCrawled\":\"2023-09-05T11:28:00.0000000Z\",\"language\":\"en\",\"isNavigational\":true},{\"id\":\"https://api.bing.microsoft.com/api/v7/#WebPages.1\",\"name\":\"San Francisco's 15 Hottest Brunch Restaurants - Eater SF\",\"url\":\"https://sf.eater.com/maps/san-franciscos-15-hottest-brunch-restaurants\",\"thumbnailUrl\":\"https://www.bing.com/th?id=OIP.-OZIpEtetvDtnrtIUfpdXwAAAA&w=80&h=80&c=1&pid=5.1\",\"isFamilyFriendly\":true,\"displayUrl\":\"https://sf.eater.com/maps/san-franciscos-15-hottest-brunch-restaurants\",\"snippet\":\"Nojo Nojo's farm-loving, San Franciscan approach to Japanese flavors translates to eye-opening brunch fare like fried spam and eggs with pickles and nori sauce, French toast (with kinako butter),...\",\"dateLastCrawled\":\"2023-09-02T02:08:00.0000000Z\",\"language\":\"en\",\"isNavigational\":false},{\"id\":\"https://api.bing.microsoft.com/api/v7/#WebPages.2\",\"name\":\"16 Standout Spots for Brunch in the East Bay - Eater SF\",\"url\":\"https://sf.eater.com/maps/best-brunch-oakland-berkeley-east-bay\",\"isFamilyFriendly\":true,\"displayUrl\":\"https://sf.eater.com/maps/best-brunch-oakland-berkeley-east-bay\",\"snippet\":\"Lulu This bright Berkeley spot does a bountiful weekend brunch, when diners can order table-sized mezze platters piled high with all sorts of fresh-baked breads, dips, and pickled vegetables.\",\"dateLastCrawled\":\"2023-09-07T01:15:00.0000000Z\",\"language\":\"en\",\"isNavigational\":false}]" }
    16:30:55.713
    gpt-4-0613
    4.16 s
    2.36¢
    SYSTEM
    You are a helpful agent completing tasks for the user. You have access to functions to make this possible. If you fail to complete the user's query, carefully try again with other tools. Please be complete. When you use a web page to answer a query, please link to it in your response.
    USER
    What are eater's top brunch places in SF?
    FUNCTION
    [{"id":"https://api.bing.microsoft.com/api/v7/#WebPages.0","name":"The Best Brunch Restaurants in San Francisco - Eater SF","url":"https://sf.eater.com/maps/best-brunch-san-francisco","thumbnailUrl":"https://www.bing.com/th?id=OIP.1Id3XqjYqtWprXbKcIOhkAHaFj&w=80&h=80&c=1&pid=5.1","isFamilyFriendly":true,"displayUrl":"https://sf.eater.com/maps/best-brunch-san-francisco","snippet":"17 San Francisco Restaurants With Spectacular Views Hilda and Jesse Hilda and Jesse is the hottest brunch spot in North Beach, where diners can break into stacks of fan-favorite buttermilk...","dateLastCrawled":"2023-09-05T11:28:00.0000000Z","language":"en","isNavigational":true},{"id":"https://api.bing.microsoft.com/api/v7/#WebPages.1","name":"San Francisco's 15 Hottest Brunch Restaurants - Eater SF","url":"https://sf.eater.com/maps/san-franciscos-15-hottest-brunch-restaurants","thumbnailUrl":"https://www.bing.com/th?id=OIP.-OZIpEtetvDtnrtIUfpdXwAAAA&w=80&h=80&c=1&pid=5.1","isFamilyFriendly":true,"displayUrl":"https://sf.eater.com/maps/san-franciscos-15-hottest-brunch-restaurants","snippet":"Nojo Nojo's farm-loving, San Franciscan approach to Japanese flavors translates to eye-opening brunch fare like fried spam and eggs with pickles and nori sauce, French toast (with kinako butter),...","dateLastCrawled":"2023-09-02T02:08:00.0000000Z","language":"en","isNavigational":false},{"id":"https://api.bing.microsoft.com/api/v7/#WebPages.2","name":"16 Standout Spots for Brunch in the East Bay - Eater SF","url":"https://sf.eater.com/maps/best-brunch-oakland-berkeley-east-bay","isFamilyFriendly":true,"displayUrl":"https://sf.eater.com/maps/best-brunch-oakland-berkeley-east-bay","snippet":"Lulu This bright Berkeley spot does a bountiful weekend brunch, when diners can order table-sized mezze platters piled high with all sorts of fresh-baked breads, dips, and pickled vegetables.","dateLastCrawled":"2023-09-07T01:15:00.0000000Z","language":"en","isNavigational":false}]
    ASSISTANT (FUNCTION CALL)
    getPage({ "url": "https://sf.eater.com/maps/best-brunch-san-francisco" })
    16:30:59.873
    22.0 s
    0.00¢
    Inputs
    { "{url}": { "url": "https://sf.eater.com/maps/best-brunch-san-francisco" } }
    Outputs
    { "value": "Here are some of the hottest brunch spots in San Francisco right now:\n\n1. Abaca - Offers a weekends-only menu with dishes like savory ensaymada French toast and traditional Filipino brunch options.\n\n2. Radhaus - A sunny beerhall with German classics and brunch options like spaetzle and eggs.\n\n3. Hilda and Jesse - A North Beach spot with fan-favorite buttermilk pancakes and hash browns.\n\n4. The Vault Garden - Enjoy al fresco brunch in the heart of FiDi with raw bar favorites and heartier options.\n\n5. Spruce - A fancy Pacific Heights restaurant with a three-course menu featuring dishes like ricotta gnudi and red wine-braised short ribs.\n\n6. Town's End Brunch - A restaurant focusing on local and organic ingredients with a menu of egg dishes, salads, sandwiches, and more.\n\n7. Charmaine's Rooftop Bar & Lounge - Offers Shakshuka Saturdays with endless shakshuka and cocktails on the rooftop of the Proper Hotel.\n\n8. Aziza - A casual restaurant with a bright brunch menu featuring sweet and savory dishes and a variety of daytime cocktails.\n\n9. Rad Radish - A plant-based restaurant with a tight selection of meat-free brunch options and a range of beverage choices.\n\n10. Otra - A modern Mexican restaurant with veggie-forward brunch options like roasted mushroom tacos and chilaquiles.\n\n11. Rosemary & Pine - A Design District restaurant with a brunch menu inspired by East Coast flavors, including oysters and housemade pastas.\n\n12. Piglet & Co. - Offers a rotating four-course set brunch menu with Asian comfort food dishes.\n\n13. Outerlands - A popular Outer Sunset spot with brunch options like Dutch pancakes and levain toast.\n\n14. Fable - A Castro neighborhood restaurant with brunch plates like buttermilk pancakes and chilaquiles.\n\n15. Piccino - A Dogpatch restaurant serving brunch with fresh pastries, omelets, and savory bread pudding.\n\n16. Birch & Rye - A modern Russian restaurant with elegant brunch dishes and cocktails made with house-infused vodkas.\n\n17. Best Kept Secret - An Outer Sunset restaurant with bottomless mimosas and beer, along with a choice of entree.\n\nThese are just a few of the many great brunch spots in San Francisco right now." }
    16:31:01.075
    gpt-3.5-turbo-16k
    20.8 s
    2.38¢
    SYSTEM
    Write a shorter version of the following content that keeps all key facts. -- Skip to main content clock menu more-arrow no yes mobile San Francisco SHARE THIS STORY * Twitter * Facebook * Pocket * Flipboard * Email San Francisco SHARE THIS STORY * Twitter * Facebook * Pocket * Flipboard * Email [ Map View Back to List More Info Less Info More Maps Here Are the Hottest New Restaurants in the East Bay, September 2023 15 Bountiful Restaurants for Vegetarians in San Francisco 12 Restaurants Perfect for a Solo Meal in San Francisco More in San Francisco See more maps * Masa cake from Blossom & Root [ Here Are the Hottest New Restaurants in the East Bay, September 2023 * Food. [ 15 Bountiful Restaurants for Vegetarians in San Francisco * [ 12 Restaurants Perfect for a Solo Meal in San Francisco [ HERE ARE THE HOTTEST PLACES TO EAT BRUNCH IN SAN FRANCISCO RIGHT NOW Fuel up for the weekend with fluffy pancakes, spaetzle and eggs, or bottomless mimosas, if that’s your thing by Lauren Saria Updated Aug 10, 2023, 2:41pm PDT SHARE THIS STORY * Share this on Facebook * Share this on Twitter * Share All sharing options SHARE ALL SHARING OPTIONS FOR: HERE ARE THE HOTTEST PLACES TO EAT BRUNCH IN SAN FRANCISCO RIGHT NOW * Pocket * Flipboard * Email View as Map [ by Lauren Saria Updated Aug 10, 2023, 2:41pm PDT SHARE THIS STORY * Share this on Facebook * Share this on Twitter * Share All sharing options SHARE ALL SHARING OPTIONS FOR: HERE ARE THE HOTTEST PLACES TO EAT BRUNCH IN SAN FRANCISCO RIGHT NOW * Pocket * Flipboard * Email One could argue that brunch requires just two things: great food, and a cocktail or other boozy beverage option to wash it down. (If you’re not specifically looking for the latter, perhaps this list of excellent breakfast options may fit the bill.) Most of San Francisco’s premier brunch options offer their menus on the weekends only, naturally, but even weekday brunch fans have some choices on this map. So whatever you’re craving — modern Filipino pastries, fluffy beignets, honey-soaked Moroccan pancakes, or just good old-fashioned eggs and bacon — let this list be your motivation to rise and shine and dine on Saturday and Sunday morning. Read More If you buy something or book a reservation from an Eater link, Vox Media may earn a commission. See our ethics policy. ABACÁ Copy Link Abaca debuted in August 2021 and the weekends-only menu is a true delight. It makes sense considering chef Francis Ang’s experience as a pastry chef shows through in dishes like a decadent savory ensaymada French toast smothered in caviar hollandaise and served with soft scrambled eggs and fried oysters. For those seeking a more traditional Filipino brunch, two silogs should scratch the itch with garlicky fried rice and sunny-side-up eggs. Whatever you do make sure to swing by the panaderia case for a lineup of pastries that really shouldn’t be missed. * Open in Google Maps * Foursquare 2700 Jones St, San Francisco, CA 94133 (415) 486-0788 (415) 486-0788 Visit Website A beef silog at Abaca. [ Lauren Saria Also featured in: * A bottle of BACARDÍ Ocho with a cocktail in a coupe glass [ 10 Places to Celebrate National Rum Month in the Bay Area * [ 14 Decadent Bloody Marys in San Francisco RADHAUS Copy Link The doors of this sunny beerhall right off the water open at 11 a.m. on Saturday or 10 a.m. on Sunday. On top of German classics such as a freshly baked pretzel and chicken schnitzel sandwich, the brunch menu adds on options such as spaetzle and eggs in a creamy mushroom sauce and pretzel French toast with berries and powdered sugar. Beer would make a natural beverage pairing here, but there are also cocktails for those who want to mix it up. * Open in Google Maps * Foursquare 2 Marina Blvd BUILDING A, San Francisco, CA 94123 (415) 445-4556 (415) 445-4556 Visit Website [ Albert Law Also featured in: * The exterior of Dalida. [ 17 San Francisco Restaurants With Spectacular Views HILDA AND JESSE Copy Link Hilda and Jesse is the hottest brunch spot in North Beach, where diners can break into stacks of fan-favorite buttermilk pancakes and savor thick squares of hash browns layered with pork sausage and sauerkraut. There’s a brunch prix fixe for $49 with options to add on courses if you please, plus cocktails, wine, beer, cider, and of course, bottomless cups of coffee. The space gets points for its whimsical design taking cues from retro diner style with its ruby red stools and checkerboard floor. * Open in Google Maps * Foursquare 701 Union St, San Francisco, CA 94133 (628) 201-4437 (628) 201-4437 Visit Website [ Patricia Chang Also featured in: * [ 17 Excellent North Beach Restaurants and Bars * [ All the Michelin Bib Gourmands in the San Francisco Bay Area, Mapped THE VAULT GARDEN Copy Link Enjoy an al fresco brunch in the heart of FiDi at the Vault Garden, situated on the plaza of the iconic 555 California Building. Brunch includes raw bar favorites such as shrimp cocktail, Dungeness crab, and platters of ice-cold oysters, plus heartier options including a salmon Benedict, loco moco, and — for something sweet — sugar-dusted beignets. * Open in Google Maps * Foursquare Plaza Level, 555 California St, San Francisco, CA 94104 (415) 508-4675 (415) 508-4675 Visit Website [ The Vault Garden Also featured in: * [ 15 Eye-Catching Private Dining Rooms in San Francisco * [ 15 Great Steakhouses in San Francisco SPRUCE Copy Link For a fancy weekend brunch, try Pacific Heights restaurant Spruce, where a three-course menu ($98) starts with just-baked coffee cake for the table, before rolling into plates like ricotta gnudi, Dungeness crab toast, and shrimp cocktail. For your entree, choose from options including buckwheat crepes, a giant lemon ricotta souffle pancake, or red wine-braised short ribs. You’ll have the option to level up with caviar service, too, plus to choose a glass or bottle from the restaurant’s extensive wine selection. * Book with OpenTable * Open in Google Maps * Foursquare 3640 Sacramento St, San Francisco, CA 94118 (415) 931-5100 (415) 931-5100 Visit Website Also featured in: * Smashburger from Wesburger [ 17 Places for Stand Out Burgers in San Francisco * [ All the Michelin Star Restaurants in the Bay Area, Mapped TOWN'S END BRUNCH Copy Link Town’s End is back — albeit with a slightly longer name that now includes the important word “brunch.” But aside from that it’s basically the same restaurant it was before the business closed during the early days of the pandemic; new owner Sam Elbandak tells Hoodline he and his wife Nazeira Twal Elbandak and cousin Samer Sweidan plan to focus on local and organic ingredients, which fill a four-page menu of egg dishes, salads, sandwiches, burgers, and more. The restaurant serves brunch from 8 a.m. to 2 p.m. daily. * Open in Google Maps 2 Townsend St, San Francisco, CA 94107 (415) 875-9984 (415) 875-9984 Visit Website [ Also featured in: * A burrito on a paper plate with the Bay Bridge in the background. [ 13 Actually Worthwhile Places to Eat and Drink on the Embarcadero SIGN UP FOR THE NEWSLETTER EATER SF Sign up for our newsletter. THANKS FOR SIGNING UP! Check your inbox for a welcome email. Email (required) Oops. Something went wrong. Please enter a valid email and try again. By submitting your email, you agree to our Terms and Privacy Notice. You can opt out at any time. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply. Subscribe CHARMAINE'S ROOFTOP BAR & LOUNGE Copy Link Head up to the roof of the Proper Hotel on Saturday from 11 a.m. to 2:30 p.m., when rooftop bar and restaurant Charmaine’s hosts Shakshuka Saturdays. The menu includes “endless shakshuka,” per the hotel website, plus cocktails such as the Afternoon Spritz made with either Lillet Blanc or Martini & Rossi Fiero and sparkling wine. A $30 per person fee includes shakshuka and entry. Reserve a table online. * Open in Google Maps 45 McAllister St, San Francisco, CA 94102 (628) 895-2039 (628) 895-2039 Visit Website [ Charmaine’s Also featured in: * [ 13 Top-Notch Rooftop Bars and Restaurants in San Francisco and the East Bay * [ Where to Eat During This Year's Burning Man Exodus AZIZA Copy Link The brunch menu at chef Mourad Lahlou’s more casual restaurant Aziza is more than bright enough to cut through the Richmond District’s notorious fog. From 10:30 a.m. to 2 p.m. on weekends, the menu includes sweet and savory dishes like smoked salmon dressed with leek, cilantro, and preserved lemon or a quivering square of custardy French toast buried under a layer of huckleberries and vanilla cream. Whatever you order, don’t skip the beghrir pancakes, a Morrocan specialty made with semolina flour and sweetened with honey. Choose from a full list of daytime cocktails including riffs on a classic bloody mary and several kinds of spritzes. * Open in Google Maps 5800 Geary Blvd, San Francisco, CA 94121 (415) 682-4196 (415) 682-4196 Visit Website [ Lauren Saria Also featured in: * [ 15 Eye-Catching Private Dining Rooms in San Francisco * [ 14 Decadent Bloody Marys in San Francisco RAD RADISH Copy Link This latest plant-based restaurant from the Back of the House (Wildseed, Beretta, Super Duper Burger) serves brunch on weekends from 11 a.m. to 3 p.m., offering a tight selection of meat-free morning options including a breakfast sandwich and a vegetable scramble, both of which feature Just Eggs. Beverage options at the stylish and casual restaurant run the gamut from probiotic sodas, coffee, and tea to wine, beer, and cocktails. * Open in Google Maps * Foursquare 301 Hayes St, San Francisco, CA 94102 (415) 916-8548 (415) 916-8548 Visit Website Also featured in: * Food. [ 15 Bountiful Restaurants for Vegetarians in San Francisco * [ Here Are the Hottest New Restaurants in San Francisco, August 2023 OTRA Copy Link Otra, the handsome modern Mexican restaurant from husband-and-wife team Nick Cobarruvias and Anna Sager Cobarruvias, expanded into brunch and the menu is just as enticing with veggie-forward dishes as you might expect. Peruse options like roasted mushroom tacos, chilaquiles, and a fried egg torta topped with refried black beans and avocado. * Open in Google Maps * Foursquare 682 Haight St, San Francisco, CA 94117 (415) 500-2774 (415) 500-2774 Visit Website The interior of Otra with blue papel picado hanging over a long dining room with concrete floors. [ Lauren Saria Also featured in: * A table of noodles and fish at Rintaro. [ The 38 Essential Restaurants in San Francisco * A spread of food. [ 15 Mighty Mexican Restaurants in San Francisco ROSEMARY & PINE Copy Link This Design District restaurant comes from the folks behind Niku Steakhouse including chef Dustin Falcon, who pulls inspiration from his East Coast upbringing to shape the menu. On the brunch menu, offered weekends from 10:30 a.m. to 2 p.m., start with oysters bathed in sweet south Florida golden passionfruit and move on to fuller dishes including eggs Benedict, Liberty Farm's duck sausage gravy and biscuits, or one of two housemade pastas. Large-format cocktails mean the whole group can turn up mimosas or Pimm’s cups. * Open in Google Maps * Foursquare 1725 Alameda St, San Francisco, CA 94103 (415) 757-0594 (415) 757-0594 Visit Website [ Patricia Chang Also featured in: * [ 14 Buzzy Coffee Cocktails Around San Francisco and the East Bay * [ Smoky, Savory, and Unexpectedly Flavored Desserts Around San Francisco PIGLET & CO. Copy Link Chef Chris Yang and partner Marcelle Gonzales Yang keep things non-traditional at their debut restaurant Piglet & Co. in the Mission. By night, they serve a nostalgia-driven menu of Asian comfort food — but on Sunday from 11 a.m. to 3 p.m. they offer a four-course set brunch menu that will rotate week to week. Previous brunch sets included black bean steamed riblets; lu rou fan, or Taiwanese braised pork rice; and coconut sweet rice cakes. Reservations are available via Resy. * Open in Google Maps * Foursquare 2170 Mission St, San Francisco, CA 94110 (415) 660-9889 (415) 660-9889 Visit Website A dining room with one brick wall and red paper lanterns hanging from wooden rafters. [ Patricia Chang Also featured in: * [ Here Are the Hottest New Restaurants in San Francisco, August 2023 OUTERLANDS Copy Link This Outer Sunset staple serves brunch Friday through Sunday from 9 a.m. to 3 p.m. when the menu includes levain toast with housemade butter and jam, breakfast sandwiches, and a very popular Dutch pancake with seasonal fruit. There’s a full beverage menu as well, but it’s a first come first served seating situation so plan accordingly. * Book with OpenTable * Open in Google Maps * Foursquare 4001 Judah St, San Francisco, CA 94122 Visit Website [ Outerlands Also featured in: * [ 12 Restaurants Perfect for a Solo Meal in San Francisco * [ 17 Essential San Francisco Sandwich Spots Right Now FABLE Copy Link Castro neighborhood restaurant Fable welcomed a new executive chef in late February. Brandon Perry comes to the New American restaurant after cooking at places including Allspice in San Mateo, Cetrella, and Town Hall. On Saturday and Sunday, weekend brunch means plates like buttermilk pancakes with kumquat coulis, chilaquiles, and a red quinoa brunch bowl with poached eggs and avocado. * Book with OpenTable * Open in Google Maps * Foursquare 558 Castro St, San Francisco, CA 94114 (415) 590-2404 (415) 590-2404 Visit Website [ Fable Also featured in: * The rooftop deck at Good Good Culture Club. [ 12 Prime Places to Eat and Drink Outside in San Francisco This Summer * A photo of toast. [ 10 San Francisco Toasts That Basically Are the Best Thing Since Sliced Bread PICCINO Copy Link Dogpatch restaurant Piccino is ready to serve lunch, dinner, and, of course, brunch. On the weekend that means starting your meal with fresh pastries, fruit, and Tuscan focaccia, then carrying on for omelets, scrambles, and savory bread pudding — just save room for one of the pizzas if you can. Sparkling wine is the move here and be sure to stop by the Euro-centric Dig Wines next door for a bottle to take home and save for later. * Open in Google Maps * Foursquare 1001 Minnesota St, San Francisco, CA 94107 (415) 824-4224 (415) 824-4224 Visit Website Also featured in: * The rooftop deck at Good Good Culture Club. [ 12 Prime Places to Eat and Drink Outside in San Francisco This Summer MORE IN MAPS * Here Are the Hottest New Restaurants in the East Bay, September 2023 * 15 Bountiful Restaurants for Vegetarians in San Francisco * 12 Restaurants Perfect for a Solo Meal in San Francisco BIRCH & RYE Copy Link As of this spring, Sunday brunch is on at the modern Russian restaurant Birch & Rye. Chef Anya El-Wattar offers elegant dishes including a buckwheat bowl with egg, mushrooms, and delicata squash; vodka-cured salmon; and a wagyu skirt steak with Yukon potatoes, mushrooms, and eggs. Wash it down with a mimosa, bloody mary, or one of the cocktails made with the house-infused vodkas. * Open in Google Maps * Foursquare 1320 Castro St, San Francisco, CA 94114 (415) 796-2265 (415) 796-2265 Visit Website An egg dish topped with caviar next to sliced toast. [ Sarah Felker Also featured in: * [ Take a Look at San Francisco’s Most Beautiful Restaurants * [ Smoky, Savory, and Unexpectedly Flavored Desserts Around San Francisco BEST KEPT SECRET Copy Link This Outer Sunset restaurant introduced brunch on March 4, which means bottomless mimosas and beer have arrived in the foggy avenues. For $50 brunch-goers get 90 minutes to down as many mimosas and beers as they can handle, along with a choice of entree from a list that includes options such as loco moco, eggs Benedict, and a burger. Brunch runs from 11 a.m. to 3 p.m. on Saturdays and is walk-in-only. * Open in Google Maps 1055 Taraval St, San Francisco, CA 94116 (415) 598-8220 (415) 598-8220 Visit Website MORE IN MAPS * Where to Fuel Up for a Shopping Spree at San Jose’s Santana Row * Where to Nosh on Jewish Food in San Francisco and the East Bay * 17 Excellent North Beach Restaurants and Bars © 2023 Vox Media, Inc. All rights reserved. Link copied to the clipboard. ABACÁ 2700 Jones St, San Francisco, CA 94133 Abaca debuted in August 2021 and the weekends-only menu is a true delight. It makes sense considering chef Francis Ang’s experience as a pastry chef shows through in dishes like a decadent savory ensaymada French toast smothered in caviar hollandaise and served with soft scrambled eggs and fried oysters. For those seeking a more traditional Filipino brunch, two silogs should scratch the itch with garlicky fried rice and sunny-side-up eggs. Whatever you do make sure to swing by the panaderia case for a lineup of pastries that really shouldn’t be missed. * Open in Google Maps * Foursquare 2700 Jones St, San Francisco, CA 94133 (415) 486-0788 (415) 486-0788 Visit Website A beef silog at Abaca. [ Lauren Saria RADHAUS 2 Marina Blvd BUILDING A, San Francisco, CA 94123 The doors of this sunny beerhall right off the water open at 11 a.m. on Saturday or 10 a.m. on Sunday. On top of German classics such as a freshly baked pretzel and chicken schnitzel sandwich, the brunch menu adds on options such as spaetzle and eggs in a creamy mushroom sauce and pretzel French toast with berries and powdered sugar. Beer would make a natural beverage pairing here, but there are also cocktails for those who want to mix it up. * Open in Google Maps * Foursquare 2 Marina Blvd BUILDING A, San Francisco, CA 94123 (415) 445-4556 (415) 445-4556 Visit Website [ Albert Law HILDA AND JESSE 701 Union St, San Francisco, CA 94133 Hilda and Jesse is the hottest brunch spot in North Beach, where diners can break into stacks of fan-favorite buttermilk pancakes and savor thick squares of hash browns layered with pork sausage and sauerkraut. There’s a brunch prix fixe for $49 with options to add on courses if you please, plus cocktails, wine, beer, cider, and of course, bottomless cups of coffee. The space gets points for its whimsical design taking cues from retro diner style with its ruby red stools and checkerboard floor. * Open in Google Maps * Foursquare 701 Union St, San Francisco, CA 94133 (628) 201-4437 (628) 201-4437 Visit Website [ Patricia Chang THE VAULT GARDEN Plaza Level, 555 California St, San Francisco, CA 94104 Enjoy an al fresco brunch in the heart of FiDi at the Vault Garden, situated on the plaza of the iconic 555 California Building. Brunch includes raw bar favorites such as shrimp cocktail, Dungeness crab, and platters of ice-cold oysters, plus heartier options including a salmon Benedict, loco moco, and — for something sweet — sugar-dusted beignets. * Open in Google Maps * Foursquare Plaza Level, 555 California St, San Francisco, CA 94104 (415) 508-4675 (415) 508-4675 Visit Website [ The Vault Garden SPRUCE 3640 Sacramento St, San Francisco, CA 94118 For a fancy weekend brunch, try Pacific Heights restaurant Spruce, where a three-course menu ($98) starts with just-baked coffee cake for the table, before rolling into plates like ricotta gnudi, Dungeness crab toast, and shrimp cocktail. For your entree, choose from options including buckwheat crepes, a giant lemon ricotta souffle pancake, or red wine-braised short ribs. You’ll have the option to level up with caviar service, too, plus to choose a glass or bottle from the restaurant’s extensive wine selection. * Book with OpenTable * Open in Google Maps * Foursquare 3640 Sacramento St, San Francisco, CA 94118 (415) 931-5100 (415) 931-5100 Visit Website TOWN'S END BRUNCH 2 Townsend St, San Francisco, CA 94107 Town’s End is back — albeit with a slightly longer name that now includes the important word “brunch.” But aside from that it’s basically the same restaurant it was before the business closed during the early days of the pandemic; new owner Sam Elbandak tells Hoodline he and his wife Nazeira Twal Elbandak and cousin Samer Sweidan plan to focus on local and organic ingredients, which fill a four-page menu of egg dishes, salads, sandwiches, burgers, and more. The restaurant serves brunch from 8 a.m. to 2 p.m. daily. * Open in Google Maps 2 Townsend St, San Francisco, CA 94107 (415) 875-9984 (415) 875-9984 Visit Website [ CHARMAINE'S ROOFTOP BAR & LOUNGE 45 McAllister St, San Francisco, CA 94102 Head up to the roof of the Proper Hotel on Saturday from 11 a.m. to 2:30 p.m., when rooftop bar and restaurant Charmaine’s hosts Shakshuka Saturdays. The menu includes “endless shakshuka,” per the hotel website, plus cocktails such as the Afternoon Spritz made with either Lillet Blanc or Martini & Rossi Fiero and sparkling wine. A $30 per person fee includes shakshuka and entry. Reserve a table online. * Open in Google Maps 45 McAllister St, San Francisco, CA 94102 (628) 895-2039 (628) 895-2039 Visit Website [ Charmaine’s AZIZA 5800 Geary Blvd, San Francisco, CA 94121 The brunch menu at chef Mourad Lahlou’s more casual restaurant Aziza is more than bright enough to cut through the Richmond District’s notorious fog. From 10:30 a.m. to 2 p.m. on weekends, the menu includes sweet and savory dishes like smoked salmon dressed with leek, cilantro, and preserved lemon or a quivering square of custardy French toast buried under a layer of huckleberries and vanilla cream. Whatever you order, don’t skip the beghrir pancakes, a Morrocan specialty made with semolina flour and sweetened with honey. Choose from a full list of daytime cocktails including riffs on a classic bloody mary and several kinds of spritzes. * Open in Google Maps 5800 Geary Blvd, San Francisco, CA 94121 (415) 682-4196 (415) 682-4196 Visit Website [ Lauren Saria RAD RADISH 301 Hayes St, San Francisco, CA 94102 This latest plant-based restaurant from the Back of the House (Wildseed, Beretta, Super Duper Burger) serves brunch on weekends from 11 a.m. to 3 p.m., offering a tight selection of meat-free morning options including a breakfast sandwich and a vegetable scramble, both of which feature Just Eggs. Beverage options at the stylish and casual restaurant run the gamut from probiotic sodas, coffee, and tea to wine, beer, and cocktails. * Open in Google Maps * Foursquare 301 Hayes St, San Francisco, CA 94102 (415) 916-8548 (415) 916-8548 Visit Website OTRA 682 Haight St, San Francisco, CA 94117 Otra, the handsome modern Mexican restaurant from husband-and-wife team Nick Cobarruvias and Anna Sager Cobarruvias, expanded into brunch and the menu is just as enticing with veggie-forward dishes as you might expect. Peruse options like roasted mushroom tacos, chilaquiles, and a fried egg torta topped with refried black beans and avocado. * Open in Google Maps * Foursquare 682 Haight St, San Francisco, CA 94117 (415) 500-2774 (415) 500-2774 Visit Website The interior of Otra with blue papel picado hanging over a long dining room with concrete floors. [ Lauren Saria ROSEMARY & PINE 1725 Alameda St, San Francisco, CA 94103 This Design District restaurant comes from the folks behind Niku Steakhouse including chef Dustin Falcon, who pulls inspiration from his East Coast upbringing to shape the menu. On the brunch menu, offered weekends from 10:30 a.m. to 2 p.m., start with oysters bathed in sweet south Florida golden passionfruit and move on to fuller dishes including eggs Benedict, Liberty Farm's duck sausage gravy and biscuits, or one of two housemade pastas. Large-format cocktails mean the whole group can turn up mimosas or Pimm’s cups. * Open in Google Maps * Foursquare 1725 Alameda St, San Francisco, CA 94103 (415) 757-0594 (415) 757-0594 Visit Website [ Patricia Chang PIGLET & CO. 2170 Mission St, San Francisco, CA 94110 Chef Chris Yang and partner Marcelle Gonzales Yang keep things non-traditional at their debut restaurant Piglet & Co. in the Mission. By night, they serve a nostalgia-driven menu of Asian comfort food — but on Sunday from 11 a.m. to 3 p.m. they offer a four-course set brunch menu that will rotate week to week. Previous brunch sets included black bean steamed riblets; lu rou fan, or Taiwanese braised pork rice; and coconut sweet rice cakes. Reservations are available via Resy. * Open in Google Maps * Foursquare 2170 Mission St, San Francisco, CA 94110 (415) 660-9889 (415) 660-9889 Visit Website A dining room with one brick wall and red paper lanterns hanging from wooden rafters. [ Patricia Chang OUTERLANDS 4001 Judah St, San Francisco, CA 94122 This Outer Sunset staple serves brunch Friday through Sunday from 9 a.m. to 3 p.m. when the menu includes levain toast with housemade butter and jam, breakfast sandwiches, and a very popular Dutch pancake with seasonal fruit. There’s a full beverage menu as well, but it’s a first come first served seating situation so plan accordingly. * Book with OpenTable * Open in Google Maps * Foursquare 4001 Judah St, San Francisco, CA 94122 Visit Website [ Outerlands FABLE 558 Castro St, San Francisco, CA 94114 Castro neighborhood restaurant Fable welcomed a new executive chef in late February. Brandon Perry comes to the New American restaurant after cooking at places including Allspice in San Mateo, Cetrella, and Town Hall. On Saturday and Sunday, weekend brunch means plates like buttermilk pancakes with kumquat coulis, chilaquiles, and a red quinoa brunch bowl with poached eggs and avocado. * Book with OpenTable * Open in Google Maps * Foursquare 558 Castro St, San Francisco, CA 94114 (415) 590-2404 (415) 590-2404 Visit Website [ Fable PICCINO 1001 Minnesota St, San Francisco, CA 94107 Dogpatch restaurant Piccino is ready to serve lunch, dinner, and, of course, brunch. On the weekend that means starting your meal with fresh pastries, fruit, and Tuscan focaccia, then carrying on for omelets, scrambles, and savory bread pudding — just save room for one of the pizzas if you can. Sparkling wine is the move here and be sure to stop by the Euro-centric Dig Wines next door for a bottle to take home and save for later. * Open in Google Maps * Foursquare 1001 Minnesota St, San Francisco, CA 94107 (415) 824-4224 (415) 824-4224 Visit Website RELATED MAPS * Here Are the Hottest New Restaurants in the East Bay, September 2023 * 15 Bountiful Restaurants for Vegetarians in San Francisco * 12 Restaurants Perfect for a Solo Meal in San Francisco BIRCH & RYE 1320 Castro St, San Francisco, CA 94114 As of this spring, Sunday brunch is on at the modern Russian restaurant Birch & Rye. Chef Anya El-Wattar offers elegant dishes including a buckwheat bowl with egg, mushrooms, and delicata squash; vodka-cured salmon; and a wagyu skirt steak with Yukon potatoes, mushrooms, and eggs. Wash it down with a mimosa, bloody mary, or one of the cocktails made with the house-infused vodkas. * Open in Google Maps * Foursquare 1320 Castro St, San Francisco, CA 94114 (415) 796-2265 (415) 796-2265 Visit Website An egg dish topped with caviar next to sliced toast. [ Sarah Felker BEST KEPT SECRET 1055 Taraval St, San Francisco, CA 94116 This Outer Sunset restaurant introduced brunch on March 4, which means bottomless mimosas and beer have arrived in the foggy avenues. For $50 brunch-goers get 90 minutes to down as many mimosas and beers as they can handle, along with a choice of entree from a list that includes options such as loco moco, eggs Benedict, and a burger. Brunch runs from 11 a.m. to 3 p.m. on Saturdays and is walk-in-only. * Open in Google Maps 1055 Taraval St, San Francisco, CA 94116 (415) 598-8220 (415) 598-8220 Visit Website RELATED MAPS * Where to Fuel Up for a Shopping Spree at San Jose’s Santana Row * Where to Nosh on Jewish Food in San Francisco and the East Bay * 17 Excellent North Beach Restaurants and Bars Eater SF homepage San Francisco FOLLOW EATER SF ONLINE: * Follow Eater SF on Twitter * Follow Eater SF on Facebook * Follow Eater SF on Youtube * Follow Eater SF on Instagram * Subscribe Log in or sign up * Log In * Sign Up SITE SEARCH Search Search EATER SF MAIN MENU * Cities * Maps * Openings * Neighborhoods * Reviews * Features * More * Cities Atlanta Austin Boston Carolinas Chicago Dallas Denver Detroit Houston Las Vegas Los Angeles Miami Nashville New Orleans New York Philadelphia Phoenix Portland, OR San Diego San Francisco Seattle Twin Cities Washington DC Eater.com * Maps * Openings * Neighborhoods * Reviews * Features ✕
    ASSISTANT
    Here are some of the hottest brunch spots in San Francisco right now: 1. Abaca - Offers a weekends-only menu with dishes like savory ensaymada French toast and traditional Filipino brunch options. 2. Radhaus - A sunny beerhall with German classics and brunch options like spaetzle and eggs. 3. Hilda and Jesse - A North Beach spot with fan-favorite buttermilk pancakes and hash browns. 4. The Vault Garden - Enjoy al fresco brunch in the heart of FiDi with raw bar favorites and heartier options. 5. Spruce - A fancy Pacific Heights restaurant with a three-course menu featuring dishes like ricotta gnudi and red wine-braised short ribs. 6. Town's End Brunch - A restaurant focusing on local and organic ingredients with a menu of egg dishes, salads, sandwiches, and more. 7. Charmaine's Rooftop Bar & Lounge - Offers Shakshuka Saturdays with endless shakshuka and cocktails on the rooftop of the Proper Hotel. 8. Aziza - A casual restaurant with a bright brunch menu featuring sweet and savory dishes and a variety of daytime cocktails. 9. Rad Radish - A plant-based restaurant with a tight selection of meat-free brunch options and a range of beverage choices. 10. Otra - A modern Mexican restaurant with veggie-forward brunch options like roasted mushroom tacos and chilaquiles. 11. Rosemary & Pine - A Design District restaurant with a brunch menu inspired by East Coast flavors, including oysters and housemade pastas. 12. Piglet & Co. - Offers a rotating four-course set brunch menu with Asian comfort food dishes. 13. Outerlands - A popular Outer Sunset spot with brunch options like Dutch pancakes and levain toast. 14. Fable - A Castro neighborhood restaurant with brunch plates like buttermilk pancakes and chilaquiles. 15. Piccino - A Dogpatch restaurant serving brunch with fresh pastries, omelets, and savory bread pudding. 16. Birch & Rye - A modern Russian restaurant with elegant brunch dishes and cocktails made with house-infused vodkas. 17. Best Kept Secret - An Outer Sunset restaurant with bottomless mimosas and beer, along with a choice of entree. These are just a few of the many great brunch spots in San Francisco right now.
    16:31:21.914
    gpt-4-0613
    78.3 s
    8.16¢
    SYSTEM
    You are a helpful agent completing tasks for the user. You have access to functions to make this possible. If you fail to complete the user's query, carefully try again with other tools. Please be complete. When you use a web page to answer a query, please link to it in your response.
    USER
    What are eater's top brunch places in SF?
    FUNCTION
    [{"id":"https://api.bing.microsoft.com/api/v7/#WebPages.0","name":"The Best Brunch Restaurants in San Francisco - Eater SF","url":"https://sf.eater.com/maps/best-brunch-san-francisco","thumbnailUrl":"https://www.bing.com/th?id=OIP.1Id3XqjYqtWprXbKcIOhkAHaFj&w=80&h=80&c=1&pid=5.1","isFamilyFriendly":true,"displayUrl":"https://sf.eater.com/maps/best-brunch-san-francisco","snippet":"17 San Francisco Restaurants With Spectacular Views Hilda and Jesse Hilda and Jesse is the hottest brunch spot in North Beach, where diners can break into stacks of fan-favorite buttermilk...","dateLastCrawled":"2023-09-05T11:28:00.0000000Z","language":"en","isNavigational":true},{"id":"https://api.bing.microsoft.com/api/v7/#WebPages.1","name":"San Francisco's 15 Hottest Brunch Restaurants - Eater SF","url":"https://sf.eater.com/maps/san-franciscos-15-hottest-brunch-restaurants","thumbnailUrl":"https://www.bing.com/th?id=OIP.-OZIpEtetvDtnrtIUfpdXwAAAA&w=80&h=80&c=1&pid=5.1","isFamilyFriendly":true,"displayUrl":"https://sf.eater.com/maps/san-franciscos-15-hottest-brunch-restaurants","snippet":"Nojo Nojo's farm-loving, San Franciscan approach to Japanese flavors translates to eye-opening brunch fare like fried spam and eggs with pickles and nori sauce, French toast (with kinako butter),...","dateLastCrawled":"2023-09-02T02:08:00.0000000Z","language":"en","isNavigational":false},{"id":"https://api.bing.microsoft.com/api/v7/#WebPages.2","name":"16 Standout Spots for Brunch in the East Bay - Eater SF","url":"https://sf.eater.com/maps/best-brunch-oakland-berkeley-east-bay","isFamilyFriendly":true,"displayUrl":"https://sf.eater.com/maps/best-brunch-oakland-berkeley-east-bay","snippet":"Lulu This bright Berkeley spot does a bountiful weekend brunch, when diners can order table-sized mezze platters piled high with all sorts of fresh-baked breads, dips, and pickled vegetables.","dateLastCrawled":"2023-09-07T01:15:00.0000000Z","language":"en","isNavigational":false}]
    FUNCTION
    Here are some of the hottest brunch spots in San Francisco right now: 1. Abaca - Offers a weekends-only menu with dishes like savory ensaymada French toast and traditional Filipino brunch options. 2. Radhaus - A sunny beerhall with German classics and brunch options like spaetzle and eggs. 3. Hilda and Jesse - A North Beach spot with fan-favorite buttermilk pancakes and hash browns. 4. The Vault Garden - Enjoy al fresco brunch in the heart of FiDi with raw bar favorites and heartier options. 5. Spruce - A fancy Pacific Heights restaurant with a three-course menu featuring dishes like ricotta gnudi and red wine-braised short ribs. 6. Town's End Brunch - A restaurant focusing on local and organic ingredients with a menu of egg dishes, salads, sandwiches, and more. 7. Charmaine's Rooftop Bar & Lounge - Offers Shakshuka Saturdays with endless shakshuka and cocktails on the rooftop of the Proper Hotel. 8. Aziza - A casual restaurant with a bright brunch menu featuring sweet and savory dishes and a variety of daytime cocktails. 9. Rad Radish - A plant-based restaurant with a tight selection of meat-free brunch options and a range of beverage choices. 10. Otra - A modern Mexican restaurant with veggie-forward brunch options like roasted mushroom tacos and chilaquiles. 11. Rosemary & Pine - A Design District restaurant with a brunch menu inspired by East Coast flavors, including oysters and housemade pastas. 12. Piglet & Co. - Offers a rotating four-course set brunch menu with Asian comfort food dishes. 13. Outerlands - A popular Outer Sunset spot with brunch options like Dutch pancakes and levain toast. 14. Fable - A Castro neighborhood restaurant with brunch plates like buttermilk pancakes and chilaquiles. 15. Piccino - A Dogpatch restaurant serving brunch with fresh pastries, omelets, and savory bread pudding. 16. Birch & Rye - A modern Russian restaurant with elegant brunch dishes and cocktails made with house-infused vodkas. 17. Best Kept Secret - An Outer Sunset restaurant with bottomless mimosas and beer, along with a choice of entree. These are just a few of the many great brunch spots in San Francisco right now.
    ASSISTANT
    Here are some of the top brunch places in San Francisco according to Eater: 1. [Abaca](https://sf.eater.com/2021/8/27/22644758/abaca-filipino-brunch-san-francisco) 2. [Radhaus](https://sf.eater.com/2018/8/13/17683022/radhaus-fort-mason-san-francisco-photos-menu) 3. [Hilda and Jesse](https://sf.eater.com/2021/2/26/22302877/hilda-and-jesse-brunch-san-francisco-north-beach) 4. [The Vault Garden](https://sf.eater.com/2020/6/18/21295258/vault-garden-san-francisco-outdoor-dining-restaurant-financial-district) 5. [Spruce](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 6. [Town's End Restaurant & Bakery](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 7. [Charmaine's Rooftop Bar & Lounge](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 8. [Aziza](https://sf.eater.com/2019/10/21/20925074/aziza-mourad-lahlou-san-francisco-reopen-photos-menu) 9. [Rad Radish](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 10. [Otra](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 11. [Rosemary & Pine](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 12. [Piglet & Co.](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 13. [Outerlands](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 14. [Fable](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 15. [Piccino](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 16. [Birch & Rye](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) 17. [Best Kept Secret](https://sf.eater.com/2021/6/18/22540923/spruce-san-francisco-reopening-indoor-dining) Please note that the availability of brunch may vary due to current health and safety guidelines. It's always a good idea to check with the restaurant for the most current information. You can find more details about these places on the [Eater SF website](https://sf.eater.com/maps/best-brunch-san-francisco).
    2. Process
    Step 1: { ... }
    Step 2: { ... }
    Step 3: { ... }
    Step 4: { ... }
    ...
    fetch: "https://eat..."
    search: "Eater top..."
    answer: "..."
    3. Test
    Search quality   GPT-4
    Two agents are answering the user query {{ inputs.query }}. The agents did the following internet searches to assist. Agent 1: {{ expected.search }} Agent 2: {{ outputs.search }} Which agent used a better search query? A) Agent 1 B) Agent 2 C) The queries are similar Explain your reasoning, then write the letter of your choice.
    Features
    Easy SDK
    import gentrace
    gentrace.init(api_key=os.getenv("GENTRACE_API_KEY"))
    openai =gentrace.OpenAI(api_key=os.getenv("OPENAI_KEY"))
    openai.chat.completions.create(messages=[{"role": "user","content": "Write an email ...",}],model="gpt-3.5-turbo",pipeline_slug="email-composer",)
    Enterprise-grade
    SOC 2 Type II & ISO 27001
    Controls in place and audit completed for SOC 2 Type II   and ISO 27001 .
    Built for scale
    Gentrace is built to handle trillions of data points with Kubernetes auto-scaling and Clickhouse.
    Admin / user controls
    Organize members; control read vs write access. More fine-grained controls coming soon.
    Self-hosted option
    Keep all of your data in your own infrastructure.
    Screenshot
    14 day trial (no credit card required)