I started working at Shopify in the product side. It's backend API development focused with some full stack elements. However with AI popping up everywhere, I get the feeling that to be employable in the future, I need to get a job as an AI engineer or work on a team that focuses on it. With Shopify heavily relying on rails as well which is seen as an older framework, I don't know if I'll have a competitive edge in the future.
As you get towards the more senior side of the ladder, the bias/preference for the expected impact actually leans towards problems than specific tools. Tools are simply a mechanic to solve problems, and don't provide any inherent value when used in isolation. Let's say I have 1000 hours: I could build a heavily polished AI-based dating app for cats or I could work for a fast food job for those hours. Generally, the fast food job will net me more value because the cat dating app provides no purpose or value to enough users where a growth/monetization plan can be executed.
If you feel like AI can solve the core problems you or your team face at work, then there's a clear problem space that can be addressed by becoming more of an AI engineer. Else, you're just giving into FOMO and wasting time that could be used to build up engineering fundamentals (communication, xfn leadership, domain knowledge, coding experience). Fundamentals will carry over with time, but anchoring yourself on specific tools or technology will not.
I have never understood the doomsday fearmongering around how AI is going to take over the world and every software engineer will have to be an MLE or unemployed. Every company with a powerful AI core still needs the following technical ICs:
The list goes on and on and on. AI/ML is just a different way of building the business logic behind a software application and power a backend. Some people have blockchain, some will do vanilla old-school CRUD rules-based stuff, and some will use AI/ML. The fact that AI/ML is innovative/new doesn't mean it will usurp all other parts of the product tech stack.
At the end of the day, just do something you're passionate about and good at (and if you're truly passionate about something, you will almost certainly get good at it). If that's AI/ML, by all means, go for it. But if you're already doing web development or data engineering or something and you love it - Just stick with that.
I love mobile development, especially Android, which is why I've stuck with it for 10 years and built 30+ mobile side projects with 4 million+ users combined. Companies still offer me jobs that pay me tons of money (and will continue to do so), because I stuck with this one field and got extremely good at it. If you want career longevity with stellar compensation, it's all about depth. Pick something and become one of the best in the world at it.
Here's some other great resources to check out:
As Brian Jenney says in his course (Break Into Tech And Become A Software Engineer), you want to be a software developer, not a framework developer.
You mentioned that Shopify uses Ruby on Rails heavily. As you use the framework to get your work done, you need to make sure that you're learning the underlying concepts that will have transferable value.
This is how you survive in a world that is increasingly going to be dominated by AI: you need to have a strong enough foundation that you can adapt your work for different types of coding environments and entirely new ways of interacting with the computer.
Brian talks about why being a 'framework developer' will limit your career here: Why Foundation Is Crucial