Overview
- Researchers have developed a model, called CRAFT, that generates cartoons based on text descritpions
- The final model was trained on more then 25,000 video clips, each of three seconds length
- The final results are mostly positive but can become a mess if not labelled properly
Introduction
Creating animated videos is a long and arduous process. Even with the introduction of computers and software in the animation industry, the task still takes quite a lot of time to accomplish. But with the advancements in AI, this time problem might just have been solved.
Researchers from the University of Illinois and the Allen Institute for Artificial Intelligence have developed an AI model, called CRAFT (Composition, Retrieval, and Fusion Network), that takes text descriptions (or captions) from the user and generates scenes from ‘The Flintstones’ cartoon series. And unlike pixel generation approaches, this model is based on text to entity segment retrieval from a video database.
The final model was developed by training it on set of more than 25,000 video clips, each three seconds and 75 frames long. As you can imagine, each video had to be labelled and annotated with which character(s) was in the scene and what the scene was about.
The AI matches videos to the words descriptions and builds a set of parameters. CRAFT can convert the provided text descriptions into video clips of this animated series, featuring characters, props and location, as it learned from the videos. It can not only put the characters into place, but also parse objects, retrieve the background, etc.
The results produced are still raw in nature. As you’ll see in the video posted below, the AI does get things right most of the time but when it gets it wrong, the video looks like a mess. Safe to way this is a work in progress, albeit with a massive amount of potential.
Below is a video that gives you a glimpse of how CRAFT works:
I would recommend reading their research paper here to gain a deeper understanding of the algorithm.
Our take on this
The Flintstones comes from an old school animation line, with relatively static backgrounds. Animation has since come a long way – the style of generating videos is far more dynamic in nature. And this will be a challenge for researchers in the video generation field going forward.
One thought is that by providing the mode more complex video frames, it could be made to adapt to the dynamic parts of the video as well. What do you think is required to improve this algorithm? Let us know in the comments section below!
Subscribe to AVBytes here to get regular data science, machine learning and AI updates in your inbox!
Senior Editor at Analytics Vidhya.Data visualization practitioner who loves reading and delving deeper into the data science and machine learning arts. Always looking for new ways to improve processes using ML and AI.
This is audible. This is MCAT audio learn complete audio review for the MCAT medical college admission test written by our team of content providers and narrated by John and Anna. Introduction and test taking strategies. Welcome to MCA. Audio learn this audio book is designed to help you prepare for taking the medical college admissions test, better known as the MCAT while the MCAT is a challenging test. This audio book will prepare you to meet this challenge. You will learn what to expect on the MCAT in terms of format, content, and scoring. We will then show you specific strategies for approaching the test itself. In addition, MCAT audio learn includes a focused review and sample questions of biological sciences, physical sciences, verbal reasoning, and the writing process, because the MCAT is such an important and comprehensive test. You may be feeling a bit anxious about taking it. That's okay. It's quite natural to feel a little intimidated. I remember the first time I took it. I didn't know what to expect, but you already have an advantage over your fellow test takers. By the time you finish this audio book, you will know exactly what to expect on the MCAT. I will work with you to share the guidance and tips that really work to improve your MCAT scores together. We will work our way through some of the examples from practice tests. Since we'll be spending some time together, allow me to introduce myself. My name is John, and I will be guiding you through proven strategies for approaching the MCAT. And my name's Anna. I'll be working with John to introduce you to the MCAT. John and I are very familiar with the MCAT and our goal is to help you feel comfortable and confident at test time, we know that taking the mcmcap might be something that makes you feel stressed or worried. I know it's easier said than done, but try not to worry and above all don't panic. Remember that by the time you take the test, you will have reviewed all the necessary subjects. You have the expertise and intelligence to do well on the test. So while you may feel like you have a long way to go before you are fully prepared, I'm here to remind you that you've already done most of the work during this audio book, we're going to help you make the most of your skills so that you can translate that work into positive test results. As you listen to this audio book, you may want to take notes, try to have a pencil and paper on hand by taking notes on what you hear, you help to solidify the content in your mind, reviewing notes will also help you to refresh your memory in between study sessions while we realize you are eager to get started. We certainly don't expect you to listen to the entire audio book all at once. Now might be a good time to pause the audio book while you get a paper in pencil. Glad to have you back after that short break, did you know, taking breaks is actually a good test preparation strategy. In fact, studies show that short chunks of time work best for studying. So that means that rather than listening to the audio book for three hours, every three days, you should listen for one hour every day, you will be able to retain much more information because your mind will be fresh and clear. After about an hour, you become fatigued and that's when frustration sometimes happens. If you ever get frustrated, as you are preparing, remember that it is okay to take a break, go for a walk, do something else for a bit. Then return to the challenge and try it again. What you want to remember is you study for the MCAT is to break large tasks into smaller, more manageable ones. Speaking of which John is going to tell you how the MCAT audio learn is laid out. Sure thing, Anna, this section is the introductory section and it is entitled prep. One. In this section, you will learn about the format of the MCAT and then will share general test taking strategies. The next section prep two shows you how to master the verbal reasoning section. This section is made up of reading comprehension questions on a variety of subjects, including social science, humanities, and selected natural sciences. And finally prep three contains a lecture review of the important science concepts drawn from biology, organic chemistry, physics, and general chemistry. I know that may sound like a lot of work, but try not to worry or panic, whatever time you can devote to listening to the MCAT audio learn will help prepare you for the MCAT. If you only have a week before the MCAT, you'll probably only have time to listen to the audiobook one time through, but don't worry. That is enough to help you get a good idea of what to expect. If you have a month or two, you can review the audiobook several times to help solidify the information. This will help you be even more prepared, whatever the amount of time you have before MCAT day, remember to stay calm and collected. That's good practice for how to adjust your attitude for the actual test. The majority of the test is passage based passages are presented and you have to be able to understand interpret and draw conclusions about what you have read. The nature of the test has several implications for how you prepare John. Why don't you tell us how to prepare for the science passage based questions? Of course, Anna science is one of my favorite sections. Here are some guidelines for the science questions. Remember the science questions come from the following subjects, biology, organic chemistry, physics, and general chemistry. The first guideline is that you must read the passage before answering the questions. This part of the test measures your ability to take in scientific information and use that information to answer questions. Even if you know about the subject matter, you will not be able to accurately answer the questions without reading the passage, read for the main ideas, try to put the main idea of the passage into your own words. You may find it helpful to take notes as you read. However, don't go overboard. If you do want to take notes, you can use the scratch paper to do so. Remember, this is a computer based test, so you won't be able to take notes on the passage itself. Take brief notes only at the level of main ideas of the paragraphs. Getting too detailed in note, taking can also slow you down. You need to strike a balance between reading briskly and retaining enough information to answer the questions efficiently while you don't want to go too slowly. You also should avoid skimming. Skimming may have been of help in the S a T or other reading comprehension tests, but these questions are much more theoretical and complex. Skimming will only confuse you instead read every word, but read it quickly. Adopt a confident posture. As you read, think I can do this. Even if the material is unfamiliar to you, you should be able to figure out most of what you need to know by reading the passage. If you come across a confusing part of the passage, don't spend too much time on it. The point of the science passages is not to master every nuance of the content, but to understand it well enough to answer the questions. Remember this is a time based test test takers who spend time rereading difficult. Parts of passages will run out of time. Don't fall into that trap. When you come across charts, graphs, and tables, notice them, but do not spend too much time on them. Pay attention to the main idea of the chart graph or table. Ask yourself, what is the point of this visual aid? What does it show me to surmise the main idea? Look at the title labels for access and headings. For questions that involve math, you should read the answer choices before you begin doing your calculations. In many cases, you will be able to estimate rather than calculate to reach the correct answer. This saves valuable time and mental energy estimation and rounding our important math skills to brush up on for the MCAT. If you reach a question that is difficult, guess at it, and then write down the questions number on your scratch paper. This way you can come back to it later. If you have time, this is a much better strategy than leaving questions blank. This way. If you are unable to return to difficult questions, you will still have a 25% chance of getting the correct answer. Don't read the questions first. You won't be able to remember all of them and you will just have to reread them again. After you read the passage, this wastes valuable time. Now let's talk a little bit about the actual test day. If you've ever done anything that involves performing well, athletics, job interviews, presentations, you already know a lot about how to approach the MCAT. It's all about staying calm and focused. Now let's imagine a time when that might be challenging. How about the night before the MCAT? What you do the night before does have an effect on how well you will perform the day of the MCAT. But one thing you don't want to do is exhaust yourself the night before don't take a practice test or start flipping through organic chemistry flashcards. Even though you are nervous, try to do something relaxing the night before, eat a healthy dinner and avoid exercising. After you eat exercising in the evening can cause insomnia. And that's the last thing you need the night before the MCAT, go on a walk or watch a movie, do something to take your mind off the MCAT, set two alarm clocks and go to bed early. Following your normal nighttime routine dress appropriately wear comfortable clothing that is not distracting or noisy. For example, a jangly bracelet may be your good luck charm, but the noise it creates will distract you and your fellow test takers, tight clothing, which makes it difficult for you to breathe is also to be avoided because the testing is now computerized. The test center will be temperature controlled. That means that high powered air conditioning may make the test center freezing cold. Even if it is summer, bring a sweater or jacket just in case you get cold. It is a good idea to dress in layers. Get there early, try to arrive in the testing center early. Use this time to take care of any restroom visits or other personal needs. Take the breaks. There are optional 10 minute breaks in between the four sections. Even if you are anxious to get the MCAT over with you should go ahead and take the breaks. Use the breaks to take care of restroom visits, resting your eyes, getting a drink of water and restocking on scratch paper. During the breaks, you are not allowed to talk on your cell phone or have conversations with others. Failing to follow this rule may cause you to be disqualified, play it safe. Avoid any conversations in cell phone use. Also, you are responsible for resuming after 10 minutes. So keep track of your time. Try to be back at your computer with one or two minutes. Spare, be confident. If you are considering taking the MCAT, you have probably already had some academic success. Remember that you can perform well under pressure. Think about past test experiences or even athletic or personal challenges. When you have succeeded, think positively. If you start slipping into negative thinking, try to replace the negative thoughts with positive ones. For example, you might find yourself thinking I'm going to forget everything. I know. As soon as I start taking the MCAT, that thought won't help you try to reframe it. As when I start to take the MCAT, I'm going to take a deep breath. Remember how well prepared I am and then do my very best. If you visualize yourself doing well, you can actually improve your performance. This concludes the introduction and general test taking strategies. Now we will proceed to prep two, the verbal reasoning section.