Brainstorming with ChatGPT vs Bard vs Bing -- results will surprise you (they certainly surprised me!)

Welcome.I'm playing with some different kinds of episodes,and this episode is going to be a little different.Instead of doing an interview or a mastermind,what I'm gonna be doing is actually telling you about something I've been using ChatGPT,and Bard,and a bunch of other tools for,

Welcome to the Prompt Engineering Podcast,where we teach you the art of writing effective prompts for AI systems like ChatGPT,Midjourney,DALL-E,and more.Here's your host,Greg Schwartz.

First place to start is a little bit of backstory.So back in2019,my mom fell down a flight of stairs and broke her neck.And,uh,fortunately she was never paralyzed,but I ended up moving from San Francisco,where I previously lived,to San Diego to be able to help her.So the reason I bring this up is she is looking for work and that can be a little challenging for a couple of reasons.One is the neck injury.She has,mostly recovered from that.So she can drive,but she can only lift five or10pounds.And she's a very outgoing person and so a lot of the stuff that would make a lot of sense typically for someone with her personality,say,sales is a little more challenging for her because she can't work most normal retail jobs.Because most normal retail jobs require you to lift20,30,40,50pounds.Second challenge is unfortunately she never finished her college degree.For the past few years,what she's done is she's worked as basically a home health aid,helping people with their medication and getting them to eat if they have a hard time eating or even cooking for them if need be.The challenge though is as her clients get older or their health declines,she loses a client.She only works with one at a time,so it's not the most stable.Not surprisingly,I'd like to help my mom have a more stable career in life.So I've been thinking,all right,maybe there's some certifications that I could find that she could go get and then be able to get a job that's more stable.So naturally I turned to ChatGPT,and I said,act as a career counselor,an executive coach with20years of experience.Your client is a67year old woman without a college degree living in San Diego.She is outgoing,sociable,but unable to work eight hours a day,do a due to a neck injury.She's previously been a salesperson at Chicos,but struggled with the political battles in the store.Suggest15certifications or trainings that could lead to a pleasant career for the remainder of her life,including links to organizations offering certification,job posting,and seller estimation.I tried using it with browsing,and maybe it was just that day,but for whatever reason,I ran it three times and each time it would just crash.So I would hit regenerate and it would then sometimes give me answers,but often it would just get stuck trying to load links.So browse has usually worked fairly well for me,but on this prompt,it really did not.So I turned off browse.And just went with this.It gave some interesting suggestions.It said,life coach,real estate agent,which is something we've actually talked about before.A bunch of other stuff.Virtual assistant,mediator,genealogist(which was actually an interesting one cuz she's very into genealogy).And customer service and that kind of thing.And I said,okay.Yoga and some of these others that are fitness related aren't really a good fit for her with the neck injury.So I said,another15,please,nothing fitness related.Gave me more.And most of these were not great,I'm scrolling through them if you're watching the video.And so then I said,okay,gimme more ideas.And then,It did,but it started drifting.So for example,it said how about a certified spiritual counselor or a certified etiquette consultant,and a bunch of other things that I went,I'm not sure that's a real certification.Nothing against those jobs just didn't sound like a,an actual certification from the way it was describing.Particularly certified travel writer and photographer.Which is from some company called Great Escape Publishing.I'm not entirely sure I believe that's a certification.So anyway,I kept going and what I noticed is it just drifted.I should mention also she really likes cooking and baking and that kind of thing.So I said,Hey,what about stuff that involves food?And it just went off the wall.It started giving all these certifications that,yeah I don't think these exist.Certified barbecue judge really,I don't know about that.But anyway tried to narrow it down and what I started noticing is each time I would say,give me more ideas.It started recycling'em.For example,in the first response it suggested mediator,and again,here is a suggestion for mediators and some other ones repeated as well.So eventually it was really starting to repeat itself.So then what I tried was more ideas that you haven't suggested yet,which if you understand how context windows worked,unsurprisingly didn't work.So just to be clear,the context window is the memory of the conversation that ChatGPT has,and part of the challenge is even though it's still on screen for you in the ChatGPT interface,it won't remember after a certain number of messages,especially when it's outputting a lot of text or you're inputting a lot of text.And so obviously the context window had gotten so far that even the things that it had previously suggested had fallen out.At this point,I said more ideas that you haven't suggested yet,and it said,here are additional certifications she might consider that were completely just off the wall.And strange and repetitive travel agent was something that had already come up.Personal stylist had already come up.Interior decorator had already come up.So many of these things,it just clearly wasn't keeping track.So I finally said,all this isn't really working quite as well as I hoped,so let me give it some more constraints.How about more ideas that don't involve fitness programming,ux,graphic design,manual labor or pets.And it still wasn't doing great,at least did that,but now it's giving totally off the wall stuff with a certified mindfulness instructor,which I like mindfulness,but I'm not sure there's an actual certification for that.And a bunch of others that,again,just weren't really fitting.So what I finally started doing was I just completely copy and pasted everything out of here and pulled out all of the job titles that it had listed so far.And so then I gave it the exact same prompt.Act as a career counselor,et cetera,and then do not include any of the following jobs.Life coach,real estate agent,personal stylist,blah,blah,blah,blah,blah.You can see it's quite a long list and that...partly worked.It did a decent job of giving a few more suggestions.Master Beekeeper was actually one that would be fun,but isn't really very relevant to San Diego,but it was definitely one that made her go,Ooh,that could be fun.Kept going through,more ideas.Most of these were not great.So then I finally just said,all right,grab all of that again.Run it again.So that helped.It definitely continued to be a little on the repetitive side.So again,as you can see,as I just keep scrolling I kept giving it that prompt again with an even longer list of things not to include.So finally I said,okay,I think I've mined ChatGPT of as much as possible,and then I went,There is another spot,let's go check one of the auto GPTs and see if they can come up with anything.So I tried God mode,which by the way is http://GodMode.Space.Not that I would recommend it.I have not had it work any of the times I've tried it,and unfortunately,this is another example of when it just totally failed.So I gave it the original prompt.It literally ran as its first action to not take an action.I don't know what to make of that.That's silly,but that's what it did.And then it said,oh,okay,great.Let's go search for sales and customer service careers.And then it spent so many cycles trying to retrieve job posts from indeed.And failing and retrying and,okay,let's try it again.And,okay,let's just go search again.And ultimately it was basically useless.So here's the results that it came up with.And needless to say,this is not a particularly helpful list.It's customer service representative,customer sales and service representative,customer service representative,entry level sales,and B2B sales.I was not looking for five,three of which are the exact same thing.So yeah,God mode a fail,but then I thought,oh,bard has access to the internet,so let's go try Bard.And it,it wasn't great.Same suggestion of customer service,administrative assistant bookkeeper web developer,graphic designer.And then I said,okay.More ideas,it said,great.Here are some more ideas for certifications or trainings that blah,blah,blah,blah,blah.Customer service representative,administrative assistant bookkeeper.It's all the same list.Now,since it's a much more concise list,it gave me more,but.It says more ideas for certifications or trainings,and it's coming up with tour guide,dog walker,babysitter,house cleaner,personal shopper,and volunteer.Okay.Obviously,volunteer is not something you get certified for as a career.So just completely a fail,but the other ones aren't things you get certified for either.So it was just kinda okay.Barb,did you not understand what I was saying?But sure.Let's give it one more shot,gimme some more ideas.And again,it just wanders off:volunteer comes up as a suggestion the third time,tutor,house cleaner,dog walker.Bard is not paying attention to the prompts,which again,let me scroll back up.Mentioned that she has a neck injury and it just tossed that out.I did bring up.You know what about food related stuff?Cuz she's a talented cook and a baker and it just gave a bunch of jobs.There wasn't anything about,these are certifications,these are jobs that require certifications.There was nothing about that at all.So finally I tried reprompt it with the same prompt again,but just to try and get it back to are there certifications that would be relevant here?And it just completely lost the thread at that point.It starts suggesting personal shoppers,which there's no certification for that.Life coaching,there are certifications for that,but they aren't particularly helpful.Grief counselor and just so many things.It.It had so clearly lost the thread that I finally just gave up.Oh,yes.It also suggested being a podcaster or a YouTuber,and there are absolutely certifications for that.If you can't tell.I'm being sarcastic.I am.So then I tried Bing and was hoping it would be a little better cuz it,it does definitely do a good job of searching for things.It didn't do a great job,but let's walk through it.So I gave it the same prompt and it gave an interesting,I'm sorry to hear about her neck injury.There are many sales opportunities available.Alright,great.Thanks.I should note this is,Basing the search off of certifications for sales jobs without college degree,which was an interesting leap for it to take.So then it says,advertising sales,real estate broker insurance sales.Retail sales.Yeah.Okay.Some of those have certifications,most of them do not.Some links around organizations that provide the certifications and that kind of thing.I said,all right,that's not super helpful.More ideas.And it then said,all right,I'll search for jobs for outgoing,sociable people with neck injury.Totally lost the certification concept and the results:exactly the same as everything else has suggested[except for GodMode],customer service,social media,event planner,travel agent,writer,virtual assistant,graphic designer,web developer,blah,blah,blah.Interestingly,then it said,here's a list of jobs that are available for people with chronic pain that offer schedule flexibility or minimal physical demands,and listed them off,most of which were the same jobs of,writer,editor,graphic designer,et cetera.But it was an interesting idea.I then said,all right,let me try and guide it a little more.More ideas given that she doesn't have a college degree.So now it says,okay,I'm searching for jobs for outgoing,sociable people without a college degree.And again,it's giving me almost all the same results.So once again,There's a big difference in quality that I notice where ChatGPT,at least for a certain amount of time,keeps the context window pretty large.So this is another example of how I have seen that ChatGPT so far is getting by far the best results.Bing and Bard both give a lot of duplicate results,even just one reply later.In this response,it's suggesting customer service social media travel writer virtual assistant and graphic designer.And then when I say more,it just tells me a bunch of the same things.Really surprisingly poor results from both Bing and Bard.I was genuinely expecting at least one of them would do better.So all in all,ChatGPT is by far the winner,by far the best results.Honestly,shockingly,how much better,especially shockingly,because I wasn't that happy with the results from ChatGPT until I went to the other ones and thought,this is really bad.This is amazingly bad.I can't even believe how bad this is.All in all,I took everything from ChatGPT threw away most of the rest of it because honestly,all of the others gave me the same information.Put all of that into a nice Google Doc and showed it to my mom,walked her through it.She thought it was some interesting ideas.So she's exploring some of these concepts now.So all in all,if you're doing this kind of brainstorming[and there's a little bit of research involved,but it's mostly brainstorming]chatGPT,particularly G P T four is still your best bet.Bing and Bard,as nice as it is that they have access to the internet,their ability to remember the conversation is much worse.And so for this kind of brainstorming and research,it just doesn't work very well.Your mileage may vary.Every time I've tried Bard and Bing,the results have been pretty mediocre It just doesn't remember the rest of the conversation to give you new information.It just keeps giving you the same information in Bing each time you ask,and the same information in Bard,each time you ask.I'm told Bard is better for code generation.Haven't tested it yet.Maybe that'll be next week.In the meantime,I'm gonna be launching my course next week,so if you'd like to give me some beta feedback on an early version of it,for a nice discount.I would love the feedback cause I wanna make it as good as possible for all of you.So if that would be of interest,please either comment below or send me an email.Talk to you soon.

Thanks for coming to the Prompt Engineering Podcast.Podcast dedicated helping you be a better prompt engineer.I also host weekly masterminds where you can collaborate with me and50other people live on Zoom to improve your prompts.Join us at http://promptengineeringmastermind.com for the schedule of the upcoming masterminds.Finally,please remember to like and subscribe.If you're listening to the audio podcast,rate us five stars.That helps us teach more people,and if you're listening to the podcast,you might want to join us on YouTube so you can actually see the prompts.You can do that by going to youtube.com/@promptEngineeringPodcast.